-- Logs begin at Wed 2022-06-15 13:47:11 UTC, end at Wed 2022-06-15 15:12:08 UTC. -- Jun 15 14:33:40.623947 dv-cinder-803823-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 14:33:40.635890 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 14:33:40 2022] *** Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: nodename: dv-cinder-803823-10-iscsi Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: machine: x86_64 Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: clock source: unix Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: pcre jit disabled Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: detected number of CPU cores: 4 Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: current working directory: / Jun 15 14:33:40.637816 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: detected binary path: /usr/bin/uwsgi-core Jun 15 14:33:40.638491 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: your processes number limit is 47680 Jun 15 14:33:40.638491 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: your memory page size is 4096 bytes Jun 15 14:33:40.638491 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: detected max file descriptor number: 2048 Jun 15 14:33:40.638491 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: lock engine: pthread robust mutexes Jun 15 14:33:40.638491 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: thunder lock: enabled Jun 15 14:33:40.638491 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 14:33:40.638491 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 14:33:40.682753 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: Python main interpreter initialized at 0x557ecbad89c0 Jun 15 14:33:40.682753 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: python threads support enabled Jun 15 14:33:40.682753 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: your server socket listen backlog is limited to 100 connections Jun 15 14:33:40.682753 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: your mercy for graceful operations on workers is 90 seconds Jun 15 14:33:40.683262 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 14:33:40.683262 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: *** Operational MODE: preforking *** Jun 15 14:33:40.683485 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: *** uWSGI is running in multiple interpreter mode *** Jun 15 14:33:40.683485 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: spawned uWSGI master process (pid: 109796) Jun 15 14:33:40.683739 dv-cinder-803823-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 14:33:40.684276 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: spawned uWSGI worker 1 (pid: 109797, cores: 1) Jun 15 14:33:40.686561 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: spawned uWSGI worker 2 (pid: 109798, cores: 1) Jun 15 14:33:40.686561 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 14:33:41.376652 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:33:41.406007 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:33:42.603277 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:33:42.603277 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: from cryptography.utils import int_from_bytes Jun 15 14:33:42.603957 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:33:42.603957 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: from cryptography.utils import int_from_bytes Jun 15 14:33:42.685311 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:33:42.685311 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: from cryptography.utils import int_from_bytes Jun 15 14:33:42.685885 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:33:42.685885 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: from cryptography.utils import int_from_bytes Jun 15 14:33:45.232381 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:33:45.233052 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:33:45.233148 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:33:45.233492 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:33:45.233744 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:33:45.234710 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.235053 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.235378 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.235695 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.236024 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.236337 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.236655 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.236971 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.237146 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:33:45.237569 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.237670 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:33:45.237761 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.237849 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.237934 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:33:45.238151 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-10-iscsi {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.238257 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:33:45.238470 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.238577 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:33:45.238774 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.238883 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.239105 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.239212 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.239420 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.239529 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.239723 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.239819 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.240042 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.240142 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.240344 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.240437 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.240675 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.240839 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.241005 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.241283 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.241392 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.241541 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.241635 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.241852 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.241955 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.242168 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-10-iscsi {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.242266 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.242483 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.242579 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.242782 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.242883 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.243120 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.243227 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.243426 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.243538 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.243725 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.243823 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.244037 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.244122 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.244336 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.244431 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-10-iscsi {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.244730 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.244835 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.245039 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.245156 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.245350 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.245441 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.245716 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.245803 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.246045 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.246146 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.246353 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.246437 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.246658 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.246748 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.246973 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.247084 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.247299 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.247398 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.247615 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.247719 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.247918 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.248011 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.248234 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.248329 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-10-iscsi {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.248550 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.248637 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.248849 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.248955 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.249153 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.249261 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.249478 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.249623 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.249803 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.249931 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.250106 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.250234 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.250408 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.250548 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.250638 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.250864 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.251066 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.251191 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.251291 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.251512 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.251605 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.251824 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.251928 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.252118 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.252206 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.252365 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.252462 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.252678 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.252773 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.252994 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.253080 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.253294 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.253384 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.253596 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.253679 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.253892 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.253985 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.254189 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.254284 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.254433 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.254524 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.254731 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.254822 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.255064 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.255167 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.255377 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.255470 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.255688 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.255772 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.255931 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.256024 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.256176 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.256311 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.256486 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.256617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.256798 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.256932 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.257096 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.257322 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.257455 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.257570 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.257685 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.257873 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.257986 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.258207 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.258291 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.258522 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.258616 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.258829 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.258922 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.259163 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.259260 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.259476 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.259573 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.259780 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.259900 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.260084 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.260189 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.260381 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.260471 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.260691 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.260782 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.261008 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.261105 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.261305 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.261401 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.261552 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.261655 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.261848 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.261932 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.262146 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.262238 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.262460 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.262557 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.262762 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.262853 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.263094 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.263198 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.263399 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.263500 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.263697 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.263849 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.263993 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.264084 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.264290 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.264372 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.264593 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.264688 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.264894 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.264978 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.265173 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.265265 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.265471 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.265576 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.265772 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.265857 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.266083 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.266174 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.266383 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.266481 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.266683 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.266801 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.266982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.267152 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.267297 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.267460 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.267590 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.267763 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.267881 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.268065 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.268181 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.268367 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.268479 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.268679 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.268763 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.268980 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.269071 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.269282 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.269373 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.269598 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.269689 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.269901 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.270006 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.270200 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.270291 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.270511 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.270599 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.270810 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.270902 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.271131 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.271231 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.271431 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.271528 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.271728 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.271830 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.272028 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.272113 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.272324 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.272408 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.272621 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.272718 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.272918 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.273008 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.273219 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.273303 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.273515 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.273614 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.273815 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.273910 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.274109 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.274193 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.274412 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.274582 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.274692 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.274772 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.274987 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.275109 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.275307 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.275402 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.275615 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.275710 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.275916 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.276006 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.276213 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.276299 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.276509 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.276593 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.276807 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.276891 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.277103 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.277195 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.277399 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.277483 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.277695 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.277779 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.277991 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.278085 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.278282 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.278369 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.278590 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.278682 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.279171 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.279274 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.279479 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.279570 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.279778 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.279870 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.280077 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.280169 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.280389 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:33:45.280480 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.281237 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.281341 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.281566 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.281660 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.281890 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.281974 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.282196 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.282280 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.282521 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.282610 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.282836 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.282926 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.283172 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.283265 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.283475 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.283603 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.283781 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.283885 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.284096 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.284205 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.284395 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.284479 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.284699 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.284793 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.285001 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.285087 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.285310 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.285394 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.285618 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.285709 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.285939 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.286024 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.286248 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.286332 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.286557 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.286649 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.286864 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.286956 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.287191 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.287285 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.287496 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.287579 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.287814 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.287910 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.288128 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.288220 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.288432 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.288524 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.288746 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.288828 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.289056 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.289149 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.289367 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.289460 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.289675 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.289768 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.289984 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.290076 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.290289 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.290385 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.290593 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.290677 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.290899 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.290984 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.291236 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.291331 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.291546 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.291637 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.291849 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.291938 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.292156 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.292240 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.292458 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.292549 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.292763 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.292846 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.293066 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.293152 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.293367 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.293450 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.293665 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.293749 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.293972 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.294118 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.294272 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.294359 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.294582 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.294667 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.294889 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.295040 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.295214 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.295306 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.295520 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.295621 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.295827 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.295910 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.296131 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.296214 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.296984 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.297092 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.297296 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.297383 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.297597 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.297682 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.297902 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.297993 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.298203 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.298291 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.298501 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.298584 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.298819 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.298917 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.299143 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.299229 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.299444 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.299527 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.299758 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.299843 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.300058 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.300141 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.300362 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.300445 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.300669 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.300756 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.300970 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.301054 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.301274 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.301356 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.301581 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.301674 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.301888 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.301972 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.302205 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.302290 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.302516 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.302602 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.302825 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.302909 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.303179 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.303279 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.303482 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.303574 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.303784 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.303869 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.304096 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.304187 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.304403 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.304490 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.304709 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.304794 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.305007 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.305099 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.305309 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.305394 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.305608 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.305691 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.305908 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.306004 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.306209 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.306293 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.306519 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.306604 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.306819 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.306912 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.307143 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.307230 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.307446 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.307530 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.307747 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.307833 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.308046 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.308130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.308343 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.308432 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.308649 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.308735 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.308947 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.309030 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.309243 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.309325 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.309539 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.309625 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.309843 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.309934 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.310140 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.310231 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.310439 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.310530 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.310738 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.310822 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.311055 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.311155 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.311354 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.311438 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.311668 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.311751 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.311993 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.312085 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.312293 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.312423 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.312590 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.312682 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.312888 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.312986 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.313228 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.313318 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.313527 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.313609 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.313839 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.313923 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.314155 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.314240 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.314462 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.314546 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.314774 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.314858 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.315103 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.315191 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.315416 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.315501 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.315716 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.315800 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.316017 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.316105 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.316322 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.316406 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.316626 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.316711 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.316937 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.317020 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.317240 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.317325 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.317552 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.317637 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.317854 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.317937 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.318157 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.318250 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.318459 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.318541 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.318763 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.318852 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.319078 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.319177 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.319386 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.319470 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.319702 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.319792 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.320018 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.320110 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.320324 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.320409 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.320637 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.320719 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.320940 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.321032 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.321324 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.321431 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.321546 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.321632 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.321846 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.321930 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.322149 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.322245 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.322455 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.322540 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.322769 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.322862 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.323100 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.323188 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.323413 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.323508 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.323718 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.323809 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.324021 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.324110 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.324322 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.324412 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.324619 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.324703 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.324918 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.325008 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.325220 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.325309 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.325531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.325616 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.325836 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.325919 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.326140 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.326233 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.326442 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.326525 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.326748 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.326839 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.327071 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.327176 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.327372 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.327456 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.327696 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.327779 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.327997 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.328091 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.328295 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.328378 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.328597 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.328688 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.328906 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.329068 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.329209 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.329295 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.329506 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.329596 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.329800 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.329886 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.330108 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.330192 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.330408 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.330491 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.330706 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.330802 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.331030 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.331117 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.331321 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.331405 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.331637 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.331721 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.331945 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.332028 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.332327 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.332556 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.332641 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.332853 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.332945 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.333253 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.333463 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.333588 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.333764 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.333854 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.334061 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.334154 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.334359 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.334443 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.334656 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.334746 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.334960 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.335077 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.335288 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.335373 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.335592 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.335675 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.335893 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.335984 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.336198 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.336282 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.336500 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.336589 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.336873 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.336978 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.337109 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.337200 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.337408 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.337492 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.337703 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.337793 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.338007 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.338091 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.338308 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.338401 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.338611 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.338867 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.338951 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.339227 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.339322 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.339541 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.339634 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.339856 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.339940 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.340172 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.340264 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.340487 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.340572 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.340791 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.340873 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.341091 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.341182 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.341395 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.341480 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.341707 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.341801 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.342029 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.342258 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.342349 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.342584 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.342670 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.342893 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.342983 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.343734 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.343825 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.344038 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.344124 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.344340 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.344431 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.344646 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.344731 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.344945 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.345030 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.345247 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.345331 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.345548 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.345663 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.345848 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.345978 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.346158 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.346375 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.346459 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.346748 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.346844 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.347072 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.347159 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.347374 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.347459 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.347677 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.347769 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.347975 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.348066 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.348274 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.348397 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.348568 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.348660 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.348871 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.348955 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.349174 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.349295 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.349475 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.349568 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.349786 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.349870 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.350082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.350167 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.350385 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.350477 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.350682 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.350768 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.351009 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.351096 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.351321 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.351415 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.351619 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.351702 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.351914 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.352004 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.352211 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.352307 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.352688 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.352799 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.352888 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.352955 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.353096 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.353213 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.353391 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.353537 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.353696 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.353874 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.354000 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.354175 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.354298 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.354475 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.354588 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.354791 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.354884 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.355120 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.355208 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.355421 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.355506 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.355720 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.355814 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.356024 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.356116 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.356326 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.356411 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.356655 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.356740 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.356955 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.357040 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.357258 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.357342 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.357553 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.357646 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.357856 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.357939 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.358152 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.358244 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.358452 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.358536 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.358747 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.359513 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.359614 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.359703 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.359912 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.359997 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.360211 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.360301 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.360528 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.360621 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.360834 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.360918 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.361134 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.361275 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.361432 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.361575 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.361734 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.361879 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.362031 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.362178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.362328 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.362488 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.362633 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.362786 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.362950 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.363110 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.363284 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.363415 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.363584 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.363721 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.363890 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.364025 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.364187 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.364322 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.364486 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.364640 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.364784 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.364946 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.365085 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.365245 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.365381 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.365542 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.365680 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.365845 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.365977 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.366142 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.366280 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.366440 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.366577 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.366745 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.366891 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.367086 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.367223 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.367397 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.367524 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.367696 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.367905 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.367996 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.368210 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.368303 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.368549 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.368643 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.368850 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.368972 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.369149 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.369232 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.369445 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.369538 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.369743 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.369835 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.370043 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.370127 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.370340 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.370425 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.370638 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.370730 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.370953 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.371053 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.371282 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.371368 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.371579 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.371663 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.371876 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.371960 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.372172 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.372257 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.372470 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.372553 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.372770 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.372862 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.373086 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.373177 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.373392 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.373478 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.373698 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.373795 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.374013 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.374103 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.374314 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.374414 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.374655 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.374751 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.374953 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.375120 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.375276 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.375359 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.375579 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.375675 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.375881 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.375965 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.376182 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.376264 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.376477 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.376567 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.376776 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.376860 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.377077 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.377160 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.377379 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.377464 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.377682 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.377764 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.377990 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.378075 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.378292 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.378377 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.378597 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.378717 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.378890 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.378973 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.379214 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.379300 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.379517 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.379600 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.379821 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.379911 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.380118 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.380214 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.380417 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.380500 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.380711 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.380802 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.381013 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.381097 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.381309 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.381400 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.381610 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.381770 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.381914 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.382020 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.382214 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.382328 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.382518 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.382614 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.382821 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.382906 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.383141 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.383251 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.383464 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.383562 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.383773 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.384188 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.384277 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.384356 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.384452 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.384533 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.384640 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.384918 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.385006 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.385224 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.385316 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.385733 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.385845 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.385927 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.386012 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.386098 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.386311 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.386398 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.386612 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.386718 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.386918 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.387048 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.387252 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.387347 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.387564 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.387648 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.387873 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.387966 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.388173 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.388258 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.388498 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.388590 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.388874 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.388965 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.389181 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.389265 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.389485 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.389577 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.389783 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.389882 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.390208 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.390307 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.390514 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.390589 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.390833 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.390916 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.391175 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.391256 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.391491 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.391574 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.391791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.391878 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.392100 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.392186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.392398 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.392481 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.392716 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.392802 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.393034 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.393117 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.393342 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.393426 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.393653 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.393746 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.393954 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.394104 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.394271 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.394409 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.394589 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.394716 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.394897 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.395054 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.395238 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.395374 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.395647 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.395733 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.395967 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.396053 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.396276 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.396360 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.396581 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.396677 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.396899 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.396983 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.397203 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.397287 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.397505 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.397601 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.397810 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.397905 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.398108 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.398192 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.398409 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.398502 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.398721 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.398806 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.399039 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.399127 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.399352 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.399463 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.399871 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.399952 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.400040 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.400127 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.400222 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.400349 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.400520 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.400666 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.400836 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.400987 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.401135 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.401288 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.401451 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.401585 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.401760 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.401890 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.402077 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.402188 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.402392 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.402476 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.402692 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.402784 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.403027 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.403127 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.403335 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.403421 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.403635 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.403729 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.404190 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.404282 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.404491 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.404583 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.404798 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.404890 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.405114 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.405210 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.405414 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.405506 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.406264 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.406367 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.406638 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.406745 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.406954 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.407091 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.407308 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.407406 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.407631 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.407716 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.407944 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.408038 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.408257 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.408344 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.408579 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.408663 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.408875 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.408965 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.409174 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.409259 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.409480 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.409565 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.409781 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.409865 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.410083 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.410169 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.410382 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.410466 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.410687 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.410771 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.410987 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.411139 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.411310 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.411395 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.411610 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.411705 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.411928 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.412021 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.412229 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.412313 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.412547 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.412642 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.412846 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.412930 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.413148 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.413240 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.413446 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.413539 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.413742 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.413833 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.414046 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.414132 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.414343 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.414428 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.414648 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.414734 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.414958 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.415438 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.415438 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.415613 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.415613 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.415757 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.415911 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.416005 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.416209 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.416296 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.416525 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.416609 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.416829 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.416913 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.417127 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.417213 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.417426 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.417519 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.417725 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.417810 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.418041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.418127 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.418346 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.418430 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.418650 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.418777 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.418964 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.419121 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.419300 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.419443 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.419619 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.419753 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.420059 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.420145 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.420378 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.420471 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.420688 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.420781 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.420998 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.421084 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.421884 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.421978 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.422229 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.422317 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.422540 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.422631 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.422848 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.422931 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.423178 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.423267 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.423488 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.423595 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.423797 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.423910 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.424124 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.424211 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.424443 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.424529 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.424765 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.425028 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.425121 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.425351 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.425438 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.425661 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.425747 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.425971 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.426064 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.426280 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.426367 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.426590 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.426683 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.426897 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.426983 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.427228 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.427314 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.427534 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.427629 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.427841 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.427934 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.428147 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.428244 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.428455 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.428551 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.428764 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.428857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.429073 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.429166 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.429382 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.429551 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.429689 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.429781 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.429995 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.430080 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.430301 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.430386 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.430609 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.430705 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.430927 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.431069 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.431274 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.431361 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.431575 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.431660 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.431883 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.431975 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.432192 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.432282 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.432500 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.432591 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.432804 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.433012 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.433098 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.433325 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.433411 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.433655 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.433747 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.433978 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.434064 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.434281 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.434365 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.434589 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.434674 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.434895 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.434982 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.435239 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.435325 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.435542 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.435636 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.435844 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.435931 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.436149 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.436241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.436456 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.436619 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.436756 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.436843 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.437106 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.437284 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.437415 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.437594 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.437717 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.437920 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.438033 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.438239 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.438323 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.438558 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.438848 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.438940 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.439190 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.439276 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.439512 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.439600 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.439814 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.439934 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.440112 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.440206 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.440416 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.440503 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.440720 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.440804 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.441018 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.441104 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.441331 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.441417 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.441632 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.441716 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.441932 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.442027 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.442284 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.442547 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.442753 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.442845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.443088 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.443191 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.443470 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.443613 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.443774 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.444083 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.444387 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.444668 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.444762 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.445000 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.445084 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.445302 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.445389 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.445603 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.445690 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.445912 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.445997 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.446252 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.446362 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.446637 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.446739 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.446819 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.446897 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.447141 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.447246 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.447452 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.447539 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.447756 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.447841 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.448061 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.448154 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.448362 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.448456 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.448668 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.448752 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.448966 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.449060 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.449266 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.449361 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.449573 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.449659 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.449874 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.449961 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.450194 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.450288 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.450493 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.450578 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.450791 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.450877 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.451115 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.451203 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.451424 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.451510 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.451725 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.451812 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.452025 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.452110 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.452326 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.452414 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.452689 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.452784 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.453007 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.453213 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.453297 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.453545 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.453633 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.453864 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.453948 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.454180 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.454270 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.454510 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.454596 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.454817 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.454902 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.455151 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.455241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.455457 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.455547 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.455777 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.455864 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.456085 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.456170 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.456392 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.456486 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.456697 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.456781 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.457007 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.457106 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.457314 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.457405 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.457618 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.457704 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.457925 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.458018 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.458231 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.458317 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.458536 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.458763 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.458849 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.459117 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.459207 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.459436 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.459531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.459748 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.459832 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.460058 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.460147 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.460366 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.460452 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.460667 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.460765 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.460966 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.461052 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.461286 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.461372 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.461593 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.461685 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.461995 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.462107 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.462197 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.462276 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.462491 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.462587 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.462793 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.462885 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.463120 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.463240 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.463430 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.463517 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.463735 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.463821 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.464037 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.464122 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.464339 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.464448 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.464645 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.464758 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.464955 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.465073 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.465260 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.465389 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.465663 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.465752 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.466003 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.466168 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.466317 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.466403 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.466621 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.466705 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.466930 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.467046 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.467259 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.467353 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.467565 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.467655 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.467871 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.467965 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.468699 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.468796 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.469011 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.469119 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.469324 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.469417 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.469649 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.469742 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.469956 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.470094 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.470256 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.470380 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.470596 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.470681 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.470903 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.471016 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.471228 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.471316 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.471529 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.471615 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.471838 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.471923 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.472142 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.472228 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.472444 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.472529 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.472746 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.472840 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.473049 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.473133 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.473352 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.473438 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.473650 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.473748 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.473950 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.474035 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.474250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.474335 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.474550 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.474643 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.474850 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.474935 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.475172 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.475259 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.475478 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.475617 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.475777 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.475866 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.476077 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.476163 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.476378 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.476465 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.476679 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.476771 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.476973 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.477057 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.477276 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.477362 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.477876 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.477982 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.477982 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.478128 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.478220 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.478308 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.478495 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.478582 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.478799 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.478898 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.479119 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.479209 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.479419 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.479516 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.479718 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.479860 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.480017 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.480103 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.480314 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.480399 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.480608 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.480706 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.480911 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.481006 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.481208 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.481295 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.481702 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.481816 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.481899 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.481978 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.482133 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.482219 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.482481 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.482580 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.482756 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.482842 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.483105 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.483193 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.483413 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.483499 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.483727 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.484390 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.484589 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.484676 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.484906 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.484994 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.485209 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.485293 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.485518 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.485615 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.485832 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.485922 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.486139 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.486224 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.486441 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.486534 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.486751 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.486835 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.487097 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.487186 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.487405 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.487504 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.487714 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.487801 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.488019 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.488106 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.488323 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.488422 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.488628 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.488722 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.488945 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.489030 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.489263 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.489357 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.489562 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.489647 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.489881 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.489967 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.490193 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.490280 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.490507 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.490655 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.490816 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.490903 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.491145 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.491234 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.491470 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.491555 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.491770 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.491871 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.492012 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:33:45.492099 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.492370 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.492674 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.492977 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.493467 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.493595 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.493912 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.494232 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.494534 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.494852 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.495194 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.495540 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.495845 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.496180 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.496504 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.496813 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.497119 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.497419 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:33:45.497657 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:33:45.554320 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO dbcounter [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Registered counter for database nova_api Jun 15 14:33:45.559617 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO dbcounter [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Registered counter for database nova_api Jun 15 14:33:45.575691 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG oslo_db.sqlalchemy.engines [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:33:45.578857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_db.sqlalchemy.engines [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:33:45.582336 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writer thread running {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:33:45.585300 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writer thread running {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:33:45.639111 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.context [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),095ba511-08d8-4454-8c74-3289cb8a8527(cell1) {{(pid=109798) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:33:45.641873 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.context [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),095ba511-08d8-4454-8c74-3289cb8a8527(cell1) {{(pid=109797) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:33:45.643731 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG oslo_concurrency.lockutils [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:33:45.645295 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG oslo_concurrency.lockutils [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:33:45.645942 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:33:45.646085 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG oslo_concurrency.lockutils [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:33:45.647519 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:33:45.648099 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG oslo_concurrency.lockutils [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:33:45.648299 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:33:45.650062 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO dbcounter [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Registered counter for database nova_cell0 Jun 15 14:33:45.650286 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:33:45.652283 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO dbcounter [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Registered counter for database nova_cell0 Jun 15 14:33:45.654142 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO dbcounter [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Registered counter for database nova_cell1 Jun 15 14:33:45.656840 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO dbcounter [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Registered counter for database nova_cell1 Jun 15 14:33:45.662082 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG oslo_db.sqlalchemy.engines [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:33:45.664256 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG oslo_db.sqlalchemy.engines [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:33:45.665850 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_db.sqlalchemy.engines [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:33:45.669641 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_db.sqlalchemy.engines [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:33:45.670598 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writer thread running {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:33:45.670934 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writer thread running {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:33:45.671873 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writer thread running {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:33:45.813173 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writer thread running {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:33:45.813630 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO dbcounter [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Registered counter for database nova_cell0 Jun 15 14:33:45.820407 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG oslo_db.sqlalchemy.engines [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:33:45.822163 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO dbcounter [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Registered counter for database nova_cell0 Jun 15 14:33:45.825052 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writer thread running {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:33:45.831599 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_db.sqlalchemy.engines [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:33:45.836044 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writer thread running {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:33:46.158255 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: WARNING keystonemiddleware.auth_token [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:33:46.161870 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: WARNING keystonemiddleware.auth_token [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:33:46.165455 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: WARNING keystonemiddleware.auth_token [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:33:46.168994 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: WARNING keystonemiddleware.auth_token [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:33:46.512051 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: WARNING keystonemiddleware.auth_token [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:33:46.513517 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: WARNING keystonemiddleware.auth_token [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:33:46.517886 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: WARNING keystonemiddleware.auth_token [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:33:46.519419 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: WARNING keystonemiddleware.auth_token [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:33:46.523188 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ecbad89c0 pid: 109798 (default app) Jun 15 14:33:46.524671 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ecbad89c0 pid: 109797 (default app) Jun 15 14:33:46.525264 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:33:46.526449 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-7edb44c2-87a9-4194-9885-53c11be53b11 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Jun 15 14:33:46.526854 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Wed Jun 15 14:33:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:04.012086 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:04.013314 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Jun 15 14:35:04.013718 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:04.024980 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writing DB stats nova_api:SELECT=3 {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:04.027272 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writing DB stats nova_cell0:SELECT=3 {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:04.028321 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writing DB stats nova_cell1:SELECT=3 {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:04.029783 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:04.472908 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-89843368-cde3-4317-9d80-e088943f0e09 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:04.502667 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-89843368-cde3-4317-9d80-e088943f0e09 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.482741 Jun 15 14:35:04.503394 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1291 bytes} [Wed Jun 15 14:35:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:06.665219 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:06.666189 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-586bb6d1-db29-4dd7-a329-8e01ed3b3bba None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 15 14:35:06.666607 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 2/4] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:06.738296 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-05909fbd-5788-4f08-b6fc-939e33283ce8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256"}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:06.757910 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:35:06.757910 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: warnings.warn(msg) Jun 15 14:35:06.786144 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-05909fbd-5788-4f08-b6fc-939e33283ce8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112749 Jun 15 14:35:06.786897 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 3/5] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:06.800425 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_api:SELECT=3 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.801329 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_cell0:SELECT=3 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.802030 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_cell1:SELECT=3 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:06.802979 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:07.011711 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-4857aa25-35db-40b0-acdd-26506dd83fc9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:07.014240 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:35:07.014240 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: warnings.warn(msg) Jun 15 14:35:07.082920 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-4857aa25-35db-40b0-acdd-26506dd83fc9 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287704 Jun 15 14:35:07.087177 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 3/6] 10.222.0.45 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:09.274892 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-05909fbd-5788-4f08-b6fc-939e33283ce8 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:09.276781 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-05909fbd-5788-4f08-b6fc-939e33283ce8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002360 Jun 15 14:35:09.277557 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 4/7] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:09.389654 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-07be9c28-cfcd-4345-8c09-b844b9ab0b40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "id": "d1", "vcpus": 1, "name": "ds512M"}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:09.407566 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:35:09.407566 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: warnings.warn(msg) Jun 15 14:35:09.428375 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-07be9c28-cfcd-4345-8c09-b844b9ab0b40 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144774 Jun 15 14:35:09.428930 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 4/8] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:35:09.441289 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-f75e2b8e-8bab-487b-9ed8-13647d758704 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:09.443324 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:35:09.443324 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: warnings.warn(msg) Jun 15 14:35:09.505901 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-f75e2b8e-8bab-487b-9ed8-13647d758704 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060205 Jun 15 14:35:09.505901 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 5/9] 10.222.0.45 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:11.683882 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-07be9c28-cfcd-4345-8c09-b844b9ab0b40 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:11.684899 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-07be9c28-cfcd-4345-8c09-b844b9ab0b40 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jun 15 14:35:11.685458 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:11.762066 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-f11646d4-dd09-4ce6-a67e-1fc0454b83a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:11.788268 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-f11646d4-dd09-4ce6-a67e-1fc0454b83a6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097078 Jun 15 14:35:11.788819 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 6/11] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:11.806657 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-0635e522-69cb-446b-a7fb-fbedf0b5f164 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:11.831684 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-0635e522-69cb-446b-a7fb-fbedf0b5f164 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030112 Jun 15 14:35:11.832379 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 6/12] 10.222.0.45 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:14.127753 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-f11646d4-dd09-4ce6-a67e-1fc0454b83a6 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:14.128757 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-f11646d4-dd09-4ce6-a67e-1fc0454b83a6 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 15 14:35:14.129162 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 7/13] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:14.189912 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-a211b3e9-a418-4921-86cd-4ba7ab805a33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "disk": 10}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:14.207793 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-a211b3e9-a418-4921-86cd-4ba7ab805a33 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072772 Jun 15 14:35:14.208347 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 7/14] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:35:14.220303 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-e592565d-223a-4f97-b039-35275c15a552 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:14.249230 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-e592565d-223a-4f97-b039-35275c15a552 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032577 Jun 15 14:35:14.249807 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 8/15] 10.222.0.45 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:35:16.502566 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-a211b3e9-a418-4921-86cd-4ba7ab805a33 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:16.504309 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-a211b3e9-a418-4921-86cd-4ba7ab805a33 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002500 Jun 15 14:35:16.505265 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 8/16] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:16.569032 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-030af9c8-8a22-47d7-a5a7-9d757e2ba490 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:16.586854 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-030af9c8-8a22-47d7-a5a7-9d757e2ba490 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074161 Jun 15 14:35:16.587557 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 9/17] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:16.599694 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-321e3c82-cbee-41b7-aaa1-fa5f14fdf201 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:16.625421 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-321e3c82-cbee-41b7-aaa1-fa5f14fdf201 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029272 Jun 15 14:35:16.635501 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 9/18] 10.222.0.45 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:18.904638 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-030af9c8-8a22-47d7-a5a7-9d757e2ba490 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:18.905651 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-030af9c8-8a22-47d7-a5a7-9d757e2ba490 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 15 14:35:18.906047 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 10/19] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:18.973604 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-ee89ba1d-7ea5-449e-9281-3a031de1a298 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:19.003737 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-ee89ba1d-7ea5-449e-9281-3a031de1a298 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.091132 Jun 15 14:35:19.007036 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 10/20] 10.222.0.45 () {60 vars in 1291 bytes} [Wed Jun 15 14:35:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:35:21.623907 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-030af9c8-8a22-47d7-a5a7-9d757e2ba490 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:21.625383 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-030af9c8-8a22-47d7-a5a7-9d757e2ba490 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002423 Jun 15 14:35:21.626069 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 11/21] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:21.687621 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-905eeb4f-9ed5-45af-99b6-290aef7bebf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:21.705790 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-905eeb4f-9ed5-45af-99b6-290aef7bebf8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073530 Jun 15 14:35:21.706441 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 11/22] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:21.718880 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-f1a19a16-4a2f-405c-8aa2-4a544bce1b8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:21.751080 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-f1a19a16-4a2f-405c-8aa2-4a544bce1b8f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035514 Jun 15 14:35:21.751913 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 12/23] 10.222.0.45 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:35:24.039452 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-905eeb4f-9ed5-45af-99b6-290aef7bebf8 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:24.041023 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-905eeb4f-9ed5-45af-99b6-290aef7bebf8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Jun 15 14:35:24.041448 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:24.111215 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-d6b20136-df20-47c6-a856-1e5f1c50ac2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "id": "2", "ram": 2048, "name": "m1.small"}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:24.132905 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-d6b20136-df20-47c6-a856-1e5f1c50ac2b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084474 Jun 15 14:35:24.135033 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 13/25] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:24.145474 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-3e958579-f038-429c-9f5b-0758b273259b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:24.172413 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-3e958579-f038-429c-9f5b-0758b273259b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030418 Jun 15 14:35:24.173094 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 13/26] 10.222.0.45 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:35:26.875347 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-d6b20136-df20-47c6-a856-1e5f1c50ac2b admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:26.876324 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-d6b20136-df20-47c6-a856-1e5f1c50ac2b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 15 14:35:26.877001 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 14/27] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:26.944156 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-41e24fc8-bc91-4726-a429-812b116bbaad admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:26.969616 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-41e24fc8-bc91-4726-a429-812b116bbaad admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086438 Jun 15 14:35:26.970181 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 14/28] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:26.985160 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-62fc3ff3-ef28-445d-b599-1ab815c27188 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:27.019130 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-62fc3ff3-ef28-445d-b599-1ab815c27188 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039408 Jun 15 14:35:27.020098 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 15/29] 10.222.0.45 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:35:29.512122 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-41e24fc8-bc91-4726-a429-812b116bbaad admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:29.513278 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-41e24fc8-bc91-4726-a429-812b116bbaad admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jun 15 14:35:29.513688 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:29.578596 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-ea9ddf45-0c4f-4fa1-a1b4-0a14cc69bfe7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "ram": 8192}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:29.597185 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-ea9ddf45-0c4f-4fa1-a1b4-0a14cc69bfe7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077102 Jun 15 14:35:29.597714 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 16/31] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:29.609951 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-dd0e301c-4f24-4652-9d7d-0963c7ab5c5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:29.644000 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-dd0e301c-4f24-4652-9d7d-0963c7ab5c5d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037623 Jun 15 14:35:29.644604 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 16/32] 10.222.0.45 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:31.872672 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-ea9ddf45-0c4f-4fa1-a1b4-0a14cc69bfe7 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:31.873733 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-ea9ddf45-0c4f-4fa1-a1b4-0a14cc69bfe7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 15 14:35:31.874159 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 17/33] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:31.938782 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-b5028dae-ccb9-431c-82fb-45a0ebf71845 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:31.957790 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-b5028dae-ccb9-431c-82fb-45a0ebf71845 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077480 Jun 15 14:35:31.958375 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 17/34] 10.222.0.45 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:35:31.971520 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-0d50a09a-108a-4c9c-bd75-c36ea9101024 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:31.999017 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-0d50a09a-108a-4c9c-bd75-c36ea9101024 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031291 Jun 15 14:35:31.999617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 18/35] 10.222.0.45 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:35:59.406435 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-b5028dae-ccb9-431c-82fb-45a0ebf71845 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:59.408396 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-b5028dae-ccb9-431c-82fb-45a0ebf71845 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002708 Jun 15 14:35:59.409275 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 18/36] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:35:59 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:59.427294 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:59.489778 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-f0dcf5df-685e-4731-9651-e4302e41a2a4 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:59.516395 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-f0dcf5df-685e-4731-9651-e4302e41a2a4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.096876 Jun 15 14:35:59.516943 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 19/37] 10.222.0.45 () {60 vars in 1291 bytes} [Wed Jun 15 14:35:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:00.538462 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-b5028dae-ccb9-431c-82fb-45a0ebf71845 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:00.539508 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-b5028dae-ccb9-431c-82fb-45a0ebf71845 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 15 14:36:00.539919 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 19/38] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:00.741153 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-2f36b08d-f5aa-4386-9e12-8f323ec6a1cb admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:00.749840 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.wsgi [None req-2f36b08d-f5aa-4386-9e12-8f323ec6a1cb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-2f36b08d-f5aa-4386-9e12-8f323ec6a1cb admin admin] Request method failure captured: Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Accept: application/json Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Accept-Encoding: gzip, deflate Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Connection: keep-alive Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Content-Length: 0 Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Host: 10.222.0.45 Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Openstack-System-Scope: None Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: User-Agent: python-novaclient Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Auth-Token: gAAAAABiqe5QXtKsxtjqPFDl4S97ER7Xcd251EZVhtwTDDzQGK8UlMbm6AvRTwEZ5hk7RQA3pHWsGo_EqcWDGGe_lmSLr9V-73nLMaaiRlp3ZtmpMMdAIEFeSJctQaGAbKeMZWJdONz0jauecefA2BWSdKQ8a9HekLDya7JRQCcPE67pY1rLxuY Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Domain-Id: None Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Domain-Name: None Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Identity-Status: Confirmed Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Is-Admin-Project: True Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Domain-Id: default Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Domain-Name: Default Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Name: admin Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Role: admin,reader,member Jun 15 14:36:00.755531 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Roles: admin,reader,member Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_66e8228804bb44bd89c3894562c27b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Tenant: admin Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Tenant-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Tenant-Name: admin Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User: admin Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Domain-Id: default Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Domain-Name: Default Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Id: a476d9b478cd40989e9e4e02fbc699e5 Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Name: admin Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: method: > Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: exception: Flavor 42 could not be found. Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: action_args: {'id': '42'} Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:00.757612 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:00.758475 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.760845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-2f36b08d-f5aa-4386-9e12-8f323ec6a1cb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:00.763253 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-2f36b08d-f5aa-4386-9e12-8f323ec6a1cb admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.077051 Jun 15 14:36:00.763253 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 20/39] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Jun 15 14:36:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:00.776093 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-b5811b09-4c6f-4948-9539-86c689d2f82b admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:00.781439 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:00.815392 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-b5811b09-4c6f-4948-9539-86c689d2f82b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.046331 Jun 15 14:36:00.816395 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 20/40] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:00.830914 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-8bf570ca-ecd1-4377-ba44-1e1e74b07dc7 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:00.871950 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-8bf570ca-ecd1-4377-ba44-1e1e74b07dc7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.044490 Jun 15 14:36:00.872952 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 21/41] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:36:00.888436 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-699ff58f-5af4-48b1-b04c-9b4a7b2adae5 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:00.898821 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.wsgi [None req-699ff58f-5af4-48b1-b04c-9b4a7b2adae5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-699ff58f-5af4-48b1-b04c-9b4a7b2adae5 admin admin] Request method failure captured: Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Accept: application/json Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Accept-Encoding: gzip, deflate Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Connection: keep-alive Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Content-Length: 0 Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Host: 10.222.0.45 Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Openstack-System-Scope: None Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: User-Agent: python-novaclient Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Auth-Token: gAAAAABiqe5QXtKsxtjqPFDl4S97ER7Xcd251EZVhtwTDDzQGK8UlMbm6AvRTwEZ5hk7RQA3pHWsGo_EqcWDGGe_lmSLr9V-73nLMaaiRlp3ZtmpMMdAIEFeSJctQaGAbKeMZWJdONz0jauecefA2BWSdKQ8a9HekLDya7JRQCcPE67pY1rLxuY Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Domain-Id: None Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Domain-Name: None Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Identity-Status: Confirmed Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Is-Admin-Project: True Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Domain-Id: default Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Domain-Name: Default Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Name: admin Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Role: admin,reader,member Jun 15 14:36:00.902489 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Roles: admin,reader,member Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_66e8228804bb44bd89c3894562c27b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Tenant: admin Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Tenant-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Tenant-Name: admin Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User: admin Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Domain-Id: default Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Domain-Name: Default Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Id: a476d9b478cd40989e9e4e02fbc699e5 Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Name: admin Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: method: > Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: exception: Flavor 42 could not be found. Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: action_args: {'id': '42'} Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:00.905186 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:00.906857 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:00.909130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-699ff58f-5af4-48b1-b04c-9b4a7b2adae5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:00.911444 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-699ff58f-5af4-48b1-b04c-9b4a7b2adae5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.022576 Jun 15 14:36:00.911444 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Jun 15 14:36:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:01.873674 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-8bf570ca-ecd1-4377-ba44-1e1e74b07dc7 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:01.875458 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-8bf570ca-ecd1-4377-ba44-1e1e74b07dc7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002452 Jun 15 14:36:01.876164 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 22/43] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:02.092932 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-bb92a5fe-fe48-44bc-a9ab-cac62bb208f3 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:02.099486 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.wsgi [None req-bb92a5fe-fe48-44bc-a9ab-cac62bb208f3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-bb92a5fe-fe48-44bc-a9ab-cac62bb208f3 admin admin] Request method failure captured: Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Accept: application/json Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Accept-Encoding: gzip, deflate Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Connection: keep-alive Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Content-Length: 0 Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Host: 10.222.0.45 Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Openstack-System-Scope: None Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: User-Agent: python-novaclient Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Auth-Token: gAAAAABiqe5RDtIqM0b5-McQoOLt49fwqNcJTui-tXj3LrCDAP8EFjApW44owChV5KoiqCuIYV1ApJgk70By-izpX94Ls8XtG5AwfJoK80TBxPUfm4FOB0iZdDMLkaC9xSl0gBrywAwHU7noaHBLz36HFKWBQdQaQY99xy8MakoJ7OrDSCLhhNU Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Domain-Id: None Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Domain-Name: None Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Identity-Status: Confirmed Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Is-Admin-Project: True Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Domain-Id: default Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Domain-Name: Default Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Name: admin Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Role: admin,reader,member Jun 15 14:36:02.101178 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Roles: admin,reader,member Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_66e8228804bb44bd89c3894562c27b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Tenant: admin Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Tenant-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Tenant-Name: admin Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User: admin Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Domain-Id: default Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Domain-Name: Default Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Id: a476d9b478cd40989e9e4e02fbc699e5 Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Name: admin Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: method: > Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: exception: Flavor 84 could not be found. Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: action_args: {'id': '84'} Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:02.104082 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:02.105692 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.107614 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-bb92a5fe-fe48-44bc-a9ab-cac62bb208f3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:02.109662 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-bb92a5fe-fe48-44bc-a9ab-cac62bb208f3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075708 Jun 15 14:36:02.109662 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 22/44] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Jun 15 14:36:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:02.114047 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-784f5eff-1abe-4caa-b0d6-5b65a3788a23 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:02.130211 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-784f5eff-1abe-4caa-b0d6-5b65a3788a23 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019633 Jun 15 14:36:02.130928 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 23/45] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:36:02.141774 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-ef34e499-7661-44b5-8e57-2c13e0d1402b admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:02.157072 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-ef34e499-7661-44b5-8e57-2c13e0d1402b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018918 Jun 15 14:36:02.157694 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:02.168377 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-d7520e1d-e7c6-43b6-ba25-619b308c6b57 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:02.174627 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.wsgi [None req-d7520e1d-e7c6-43b6-ba25-619b308c6b57 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-d7520e1d-e7c6-43b6-ba25-619b308c6b57 admin admin] Request method failure captured: Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Accept: application/json Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Accept-Encoding: gzip, deflate Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Connection: keep-alive Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Content-Length: 0 Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Host: 10.222.0.45 Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Openstack-System-Scope: None Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: User-Agent: python-novaclient Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Auth-Token: gAAAAABiqe5RDtIqM0b5-McQoOLt49fwqNcJTui-tXj3LrCDAP8EFjApW44owChV5KoiqCuIYV1ApJgk70By-izpX94Ls8XtG5AwfJoK80TBxPUfm4FOB0iZdDMLkaC9xSl0gBrywAwHU7noaHBLz36HFKWBQdQaQY99xy8MakoJ7OrDSCLhhNU Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Domain-Id: None Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Domain-Name: None Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Identity-Status: Confirmed Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Is-Admin-Project: True Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Domain-Id: default Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Domain-Name: Default Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Name: admin Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Role: admin,reader,member Jun 15 14:36:02.176250 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Roles: admin,reader,member Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_66e8228804bb44bd89c3894562c27b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Tenant: admin Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Tenant-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Tenant-Name: admin Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User: admin Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Domain-Id: default Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Domain-Name: Default Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Id: a476d9b478cd40989e9e4e02fbc699e5 Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Name: admin Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: method: > Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: exception: Flavor 84 could not be found. Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: action_args: {'id': '84'} Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:02.178866 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:02.180617 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:02.183041 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-d7520e1d-e7c6-43b6-ba25-619b308c6b57 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:02.185160 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-d7520e1d-e7c6-43b6-ba25-619b308c6b57 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013489 Jun 15 14:36:02.185160 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 24/47] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Jun 15 14:36:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 14:36:03.558098 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-ef34e499-7661-44b5-8e57-2c13e0d1402b admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:03.559130 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-ef34e499-7661-44b5-8e57-2c13e0d1402b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 15 14:36:03.559524 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 24/48] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:03.765229 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-77fa3d21-dbb0-49c7-b4ea-e2fc55e67662 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:03.775804 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.wsgi [None req-77fa3d21-dbb0-49c7-b4ea-e2fc55e67662 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-77fa3d21-dbb0-49c7-b4ea-e2fc55e67662 admin admin] Request method failure captured: Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Accept: application/json Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Accept-Encoding: gzip, deflate Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Connection: keep-alive Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Content-Length: 0 Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Host: 10.222.0.45 Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Openstack-System-Scope: None Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: User-Agent: python-novaclient Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Auth-Token: gAAAAABiqe5T9WnVnthUteUrjVjlO2ERM-kYqv_6O7ORfDIE0sZK6AqV4xck7KzjpPZYXqWiA-uN9Po6bvCkgSJ3YYUClkrc6HBAacztNAoslasQFerOwMjUxkCbH24OeF-RbcPxcXGTIIS9dYVWyV_7f1KwKYEed_3TrDF-JnHdbZWnzFluHyI Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Domain-Id: None Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Domain-Name: None Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Identity-Status: Confirmed Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Is-Admin-Project: True Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Domain-Id: default Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Domain-Name: Default Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Project-Name: admin Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Role: admin,reader,member Jun 15 14:36:03.778791 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Roles: admin,reader,member Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_66e8228804bb44bd89c3894562c27b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Tenant: admin Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Tenant-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-Tenant-Name: admin Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User: admin Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Domain-Id: default Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Domain-Name: Default Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Id: a476d9b478cd40989e9e4e02fbc699e5 Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: X-User-Name: admin Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: method: > Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: exception: Flavor 451 could not be found. Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: action_args: {'id': '451'} Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:03.780811 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:03.781613 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.782845 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-77fa3d21-dbb0-49c7-b4ea-e2fc55e67662 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:03.784415 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-77fa3d21-dbb0-49c7-b4ea-e2fc55e67662 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.077765 Jun 15 14:36:03.784415 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 25/49] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Jun 15 14:36:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 14:36:03.793244 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-58aa852d-93ba-4fd8-8d9d-6bb43582a773 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:03.810534 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-58aa852d-93ba-4fd8-8d9d-6bb43582a773 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020905 Jun 15 14:36:03.811233 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:03.825567 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:03.842582 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024178 Jun 15 14:36:03.843172 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 26/51] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:36:03.860397 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-bee48698-3825-419f-b19e-1c5f1b2e5ead admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:03.869871 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.wsgi [None req-bee48698-3825-419f-b19e-1c5f1b2e5ead admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-bee48698-3825-419f-b19e-1c5f1b2e5ead admin admin] Request method failure captured: Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Accept: application/json Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Accept-Encoding: gzip, deflate Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Connection: keep-alive Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Content-Length: 0 Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Host: 10.222.0.45 Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Openstack-System-Scope: None Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: User-Agent: python-novaclient Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Auth-Token: gAAAAABiqe5T9WnVnthUteUrjVjlO2ERM-kYqv_6O7ORfDIE0sZK6AqV4xck7KzjpPZYXqWiA-uN9Po6bvCkgSJ3YYUClkrc6HBAacztNAoslasQFerOwMjUxkCbH24OeF-RbcPxcXGTIIS9dYVWyV_7f1KwKYEed_3TrDF-JnHdbZWnzFluHyI Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Domain-Id: None Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Domain-Name: None Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Identity-Status: Confirmed Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Is-Admin-Project: True Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Domain-Id: default Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Domain-Name: Default Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Project-Name: admin Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Role: admin,reader,member Jun 15 14:36:03.872982 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Roles: admin,reader,member Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_66e8228804bb44bd89c3894562c27b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66e8228804bb44bd89c3894562c27b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Tenant: admin Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Tenant-Id: 66e8228804bb44bd89c3894562c27b12 Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-Tenant-Name: admin Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User: admin Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Domain-Id: default Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Domain-Name: Default Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Id: a476d9b478cd40989e9e4e02fbc699e5 Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: X-User-Name: admin Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: method: > Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: exception: Flavor 451 could not be found. Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: action_args: {'id': '451'} Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:03.875241 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:03.876757 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: ERROR nova.api.openstack.wsgi Jun 15 14:36:03.879338 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-bee48698-3825-419f-b19e-1c5f1b2e5ead admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:03.881612 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-bee48698-3825-419f-b19e-1c5f1b2e5ead admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.025339 Jun 15 14:36:03.881612 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 26/52] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Jun 15 14:36:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:04.829028 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:04.830924 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002623 Jun 15 14:36:04.831621 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:05.052176 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-1badfe4b-4bd9-4dfe-bad1-e3b9ec26798f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:36:05.080481 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-1badfe4b-4bd9-4dfe-bad1-e3b9ec26798f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.101813 Jun 15 14:36:05.081620 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 27/54] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Jun 15 14:36:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:06.069495 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:06.071240 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002964 Jun 15 14:36:06.071917 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 28/55] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:06.352120 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-6b746917-9960-4b31-9812-9ed9e328be0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:36:06.372382 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-6b746917-9960-4b31-9812-9ed9e328be0a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.087952 Jun 15 14:36:06.373017 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 28/56] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Jun 15 14:36:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:07.313654 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:07.315621 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002538 Jun 15 14:36:07.316341 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 29/57] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:07.541444 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-1db54cd4-fa7f-48fb-8707-62468884e1de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:36:07.560570 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-1db54cd4-fa7f-48fb-8707-62468884e1de admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.079746 Jun 15 14:36:07.561131 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 29/58] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Jun 15 14:36:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:08.499487 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:08.501181 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002444 Jun 15 14:36:08.501850 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 30/59] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:08.731807 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-1767c3b8-0e86-4378-9da8-919ea0999b37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:36:08.751473 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-1767c3b8-0e86-4378-9da8-919ea0999b37 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.108480 Jun 15 14:36:08.752020 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 30/60] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Jun 15 14:36:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:09.890436 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:09.892125 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002439 Jun 15 14:36:09.892808 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 31/61] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:10.191254 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-7d499f55-5847-475d-9bbf-e05e747ff11d admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:10.213196 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-7d499f55-5847-475d-9bbf-e05e747ff11d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080638 Jun 15 14:36:10.214127 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 31/62] 10.222.0.45 () {60 vars in 1202 bytes} [Wed Jun 15 14:36:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:37:03.047380 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:03.048401 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-7d99d3f1-0857-44ac-8596-9cf0fccf6b0d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jun 15 14:37:03.048817 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 32/63] 10.222.0.45 () {54 vars in 930 bytes} [Wed Jun 15 14:37:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:37:03.060788 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:03.114277 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-cd692677-21ba-4f25-8a34-5f20f0130527 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:03.135384 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-cd692677-21ba-4f25-8a34-5f20f0130527 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079302 Jun 15 14:37:03.135959 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 32/64] 10.222.0.45 () {60 vars in 1291 bytes} [Wed Jun 15 14:37:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:37:03.160927 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-677a87cb-f427-4274-b617-da30ba7777c0 admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:03.164443 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG dbcounter [-] [109798] Writing DB stats nova_api:SELECT=14 {{(pid=109798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:03.170375 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-677a87cb-f427-4274-b617-da30ba7777c0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013651 Jun 15 14:37:03.170937 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 33/65] 10.222.0.45 () {60 vars in 1282 bytes} [Wed Jun 15 14:37:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:37:03.183824 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-23f033b3-d98b-4cfe-9d01-176cf5d1fc78 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:03.192439 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-23f033b3-d98b-4cfe-9d01-176cf5d1fc78 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012285 Jun 15 14:37:03.193004 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 33/66] 10.222.0.45 () {60 vars in 1285 bytes} [Wed Jun 15 14:37:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:37:03.213077 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:03.224329 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.022334 Jun 15 14:37:03.224917 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 34/67] 10.222.0.45 () {60 vars in 1285 bytes} [Wed Jun 15 14:37:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:37:03.242599 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-3a803a87-f99a-4b76-a6e3-c76b4f05076a admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:03.256307 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-3a803a87-f99a-4b76-a6e3-c76b4f05076a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018091 Jun 15 14:37:03.257172 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 34/68] 10.222.0.45 () {60 vars in 1282 bytes} [Wed Jun 15 14:37:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:40:35.300690 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:35.302434 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002482 Jun 15 14:40:35.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 35/69] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:40:35.464609 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_api:SELECT=6 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:40:35.605546 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-be275753-9d0f-4bdd-999a-e255d5c149f7 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:35.606713 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:40:35.606713 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: warnings.warn(msg) Jun 15 14:40:35.608505 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-be275753-9d0f-4bdd-999a-e255d5c149f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:35.608946 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-be275753-9d0f-4bdd-999a-e255d5c149f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:35.609731 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-be275753-9d0f-4bdd-999a-e255d5c149f7 admin admin] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:35.610155 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-be275753-9d0f-4bdd-999a-e255d5c149f7 admin admin] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:35.645124 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-be275753-9d0f-4bdd-999a-e255d5c149f7 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.181864 Jun 15 14:40:35.645695 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 35/70] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Jun 15 14:40:35 2022] GET /compute/v2.1/os-services => generated 794 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:40:36.540384 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:36.541406 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jun 15 14:40:36.541913 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 36/71] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:40:36.739442 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-866b3471-d88a-4e12-a8b1-bbf8e5ed91fc admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:36.740746 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:40:36.740746 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: warnings.warn(msg) Jun 15 14:40:36.741989 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-866b3471-d88a-4e12-a8b1-bbf8e5ed91fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:36.742438 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-866b3471-d88a-4e12-a8b1-bbf8e5ed91fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:36.743275 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-866b3471-d88a-4e12-a8b1-bbf8e5ed91fc admin admin] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:36.743712 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-866b3471-d88a-4e12-a8b1-bbf8e5ed91fc admin admin] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:36.765816 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-866b3471-d88a-4e12-a8b1-bbf8e5ed91fc admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.084775 Jun 15 14:40:36.766283 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 36/72] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Jun 15 14:40:36 2022] GET /compute/v2.1/os-services => generated 794 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:40:48.100047 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:48.101054 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 15 14:40:48.101446 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:40:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:40:48.256871 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_cell0:SELECT=4 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:40:48.257873 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_cell1:SELECT=4 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:40:48.258162 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG dbcounter [-] [109797] Writing DB stats nova_api:SELECT=8 {{(pid=109797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:40:48.312502 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-f9067585-79e0-4d8e-a8b3-049669a46333 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:48.313882 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:40:48.313882 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: warnings.warn(msg) Jun 15 14:40:48.315369 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-f9067585-79e0-4d8e-a8b3-049669a46333 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:48.315876 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-f9067585-79e0-4d8e-a8b3-049669a46333 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:48.316821 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-f9067585-79e0-4d8e-a8b3-049669a46333 admin admin] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:48.317337 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-f9067585-79e0-4d8e-a8b3-049669a46333 admin admin] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:48.343343 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-f9067585-79e0-4d8e-a8b3-049669a46333 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.091516 Jun 15 14:40:48.343908 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 37/74] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Jun 15 14:40:48 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:40:49.278086 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: DEBUG nova.api.openstack.wsgi [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] Calling method '>' {{(pid=109798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:49.279721 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: INFO nova.api.openstack.requestlog [None req-8a175c01-257c-4bc9-a53c-bf55473d1c7c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Jun 15 14:40:49.280132 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: [pid: 109798|app: 0|req: 38/75] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Jun 15 14:40:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:40:49.495500 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG nova.api.openstack.wsgi [None req-0729fb8f-af44-4499-95c7-dae25ede1b40 admin admin] Calling method '>' {{(pid=109797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:49.496819 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:40:49.496819 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: warnings.warn(msg) Jun 15 14:40:49.498542 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-0729fb8f-af44-4499-95c7-dae25ede1b40 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:49.498978 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-0729fb8f-af44-4499-95c7-dae25ede1b40 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:49.499896 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-0729fb8f-af44-4499-95c7-dae25ede1b40 admin admin] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:49.500317 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: DEBUG oslo_concurrency.lockutils [None req-0729fb8f-af44-4499-95c7-dae25ede1b40 admin admin] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:49.523821 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: INFO nova.api.openstack.requestlog [None req-0729fb8f-af44-4499-95c7-dae25ede1b40 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083469 Jun 15 14:40:49.524147 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: [pid: 109797|app: 0|req: 38/76] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Jun 15 14:40:49 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:41:53.824976 dv-cinder-803823-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 14:41:53.826181 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: Wed Jun 15 14:41:53 2022 - graceful shutdown triggered... Jun 15 14:41:53.826616 dv-cinder-803823-10-iscsi devstack@n-api.service[109797]: Gracefully killing worker 1 (pid: 109797)... Jun 15 14:41:53.827279 dv-cinder-803823-10-iscsi devstack@n-api.service[109798]: Gracefully killing worker 2 (pid: 109798)... Jun 15 14:41:54.826027 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: worker 1 buried after 1 seconds Jun 15 14:41:54.826027 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: worker 2 buried after 1 seconds Jun 15 14:41:54.826027 dv-cinder-803823-10-iscsi devstack@n-api.service[109796]: goodbye to uWSGI. Jun 15 14:41:54.827786 dv-cinder-803823-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 14:41:54.828399 dv-cinder-803823-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 14:41:54.831393 dv-cinder-803823-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 14:41:54.847155 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 14:41:54 2022] *** Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: nodename: dv-cinder-803823-10-iscsi Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: machine: x86_64 Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: clock source: unix Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: pcre jit disabled Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: detected number of CPU cores: 4 Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: current working directory: / Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: detected binary path: /usr/bin/uwsgi-core Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: your processes number limit is 47680 Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: your memory page size is 4096 bytes Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: detected max file descriptor number: 2048 Jun 15 14:41:54.850189 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: lock engine: pthread robust mutexes Jun 15 14:41:54.852107 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: thunder lock: enabled Jun 15 14:41:54.852107 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 14:41:54.852107 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 14:41:54.895761 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: Python main interpreter initialized at 0x555c65aa29c0 Jun 15 14:41:54.895761 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: python threads support enabled Jun 15 14:41:54.895761 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: your server socket listen backlog is limited to 100 connections Jun 15 14:41:54.895761 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: your mercy for graceful operations on workers is 90 seconds Jun 15 14:41:54.896513 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 14:41:54.896513 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: *** Operational MODE: preforking *** Jun 15 14:41:54.896513 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: *** uWSGI is running in multiple interpreter mode *** Jun 15 14:41:54.896513 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: spawned uWSGI master process (pid: 124163) Jun 15 14:41:54.896745 dv-cinder-803823-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 14:41:54.899397 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: spawned uWSGI worker 1 (pid: 124178, cores: 1) Jun 15 14:41:54.899397 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: spawned uWSGI worker 2 (pid: 124179, cores: 1) Jun 15 14:41:54.899397 dv-cinder-803823-10-iscsi devstack@n-api.service[124163]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 14:41:55.604417 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:41:55.682831 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:41:57.068168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:41:57.068168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: from cryptography.utils import int_from_bytes Jun 15 14:41:57.068168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:41:57.068168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: from cryptography.utils import int_from_bytes Jun 15 14:41:57.104964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:41:57.104964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: from cryptography.utils import int_from_bytes Jun 15 14:41:57.105840 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:41:57.105840 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: from cryptography.utils import int_from_bytes Jun 15 14:41:59.810294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:41:59.810946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:41:59.811087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:41:59.811450 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:41:59.811702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:41:59.812092 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.812422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.812747 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.813070 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.813405 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.813722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.814052 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.814373 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.814704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.814968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.815324 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.815654 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-10-iscsi {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.815982 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.816293 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.816611 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.816935 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.817248 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.817574 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.817888 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.818392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.819692 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.820307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.820911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.821536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.822094 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.822656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.823355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.823929 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.824756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.825307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.826046 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-10-iscsi {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.826612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.827222 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.828295 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.829049 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.829603 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.830151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.830712 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.831323 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.831869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.832442 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.833039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.833598 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.834165 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.835575 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.836119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.836664 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.837225 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.837866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.838561 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.839318 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.839598 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.840165 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.840732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.841293 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.841765 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.842200 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.842761 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.843354 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.843994 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.844606 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.845155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.845694 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.846232 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.846767 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.847358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.847895 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.848795 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.849171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.849742 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.850830 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.851826 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.852542 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.852974 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.853521 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.854175 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.854745 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.855191 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.855528 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.855865 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.856186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.856510 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.856826 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.857154 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.857498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.857811 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.858074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.858517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.858842 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.859204 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.859518 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.860622 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.860622 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.860622 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.860887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.861106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.861620 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.861969 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.862285 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.862596 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.862908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.863248 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.863559 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.863890 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.865748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.865748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.865748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.865748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.866627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.867241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.867241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.867478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.867941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.868263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.868726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.869059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.870028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.870356 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.870687 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.871016 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.871355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.871675 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.872020 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.872336 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.872646 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.872958 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.873268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.873580 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.873889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.874258 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.874639 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.874965 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.875313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.875634 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.875948 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.876259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.876584 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.876929 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.877264 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.877609 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.877893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:41:59.878324 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.878431 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:41:59.878524 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.878629 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.878724 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:41:59.879092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:41:59.879298 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.879401 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:41:59.879664 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.879788 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.879989 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.880272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.880378 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.880612 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.880712 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.880943 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.881042 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.881790 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.881916 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.882116 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.882215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.882436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.882535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.882764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.882863 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.883109 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.883206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.883390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.883493 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.883719 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.883811 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.884057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-10-iscsi {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.884160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.884381 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.884474 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.884697 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.884800 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.885019 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.885111 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.885338 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.885845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.886005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.886152 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.886248 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.886342 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.886427 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.886778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.886870 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.887277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.887394 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.887550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.887712 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.887868 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.888033 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.888187 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.888357 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.888516 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.888707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.888981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.889109 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.889307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.889414 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.889634 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.889756 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.889950 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.890050 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.890268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.890384 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.890587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.890798 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.891025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-10-iscsi {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.891202 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.891358 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.891527 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.891680 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.891870 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.891995 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.892192 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.892428 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.892530 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.892751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.892844 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.893071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.893197 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.893404 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.893588 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.893744 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.893862 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.894062 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.894185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.894370 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.894497 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.894684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.895015 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.895132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.895334 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.895479 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.896944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.897675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.897675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.897846 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.897947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.897947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.898119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.898202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.898307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.898399 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.898483 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.898582 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.898673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.898763 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.900356 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.900507 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.900637 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.900637 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.900910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.901032 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.901162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.901252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.901252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.901472 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.901561 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.901647 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.901737 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.902023 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.902288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.902526 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.902686 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.902831 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.902976 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.903270 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.903476 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.903583 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.903901 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.904069 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.904221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.904386 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.904537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.904796 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.904955 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.905130 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.905279 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.905456 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.905786 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.905930 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.906110 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.906257 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.906437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.906595 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.906772 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.906905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.907111 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.907247 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.907485 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.907619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.907773 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.907906 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.908154 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.908298 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.908447 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.908577 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.908706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.908855 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.908999 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.909164 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.909578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.909731 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.909916 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.910080 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.910229 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.910229 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.910493 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.910641 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.910840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.911023 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.911173 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.911454 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.911585 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.911796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.911945 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.912102 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.912256 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.912410 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.912579 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.912740 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.912883 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.913028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.913203 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.913351 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.913633 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.913778 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.913973 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.914092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.914310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.914537 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.914669 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.914947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.915134 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.915280 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.915590 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.915725 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.915902 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.916117 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.916254 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.916516 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.916641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.916834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.917004 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.917152 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.917292 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.917470 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.917632 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.917797 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.917956 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.918122 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.918405 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.918613 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.918773 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.918965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.919311 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.919592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.919834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.920146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.920397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.920710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.920939 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.921370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.921530 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.921949 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.922095 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.922369 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.922550 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.922730 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.923013 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.923208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.923382 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.923782 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.923967 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.924317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.924559 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.928848 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.929125 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.929125 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.929608 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.929608 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.930163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.930418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.930418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.930918 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.931215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.931215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.931215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.931926 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.932170 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.932170 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.932612 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.932780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.932926 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.933092 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.933249 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.933392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.933545 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.933710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.933710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.933986 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.934126 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.934282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.934422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.934576 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.934720 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.934720 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.935020 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.936722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.936722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.936928 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.937015 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.937015 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.937221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.937340 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.937512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.937512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.937743 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.937873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.937873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.938082 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.938195 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.938306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.938388 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.938388 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.938388 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.938588 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.938691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.938766 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.938835 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.938904 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.938979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.938979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.939143 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.939222 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.939308 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.939308 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.939458 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:41:59.939536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.939648 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.939785 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.939889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.939983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.940231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.940635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.940816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.941111 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.941956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.941956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.942305 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.942524 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.942761 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.943144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.943360 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.944774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.945142 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.945305 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.945463 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.945650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.945863 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.946097 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.946345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.946560 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.946783 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.947026 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.947239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.947451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.947451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.947723 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.947890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.947890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.947890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.948504 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.948669 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.948669 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.948954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.949119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.949299 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.949467 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.949670 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.950077 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.950242 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.950449 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.950665 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.950833 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.951143 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.951288 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.951482 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.951576 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.951896 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.951997 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.952447 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.952547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.952677 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.952987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.953099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.953320 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.953563 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.953667 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.953953 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.954053 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.954291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.954386 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.954646 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.955347 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.955517 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.955517 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.958764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.958764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.958764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.958764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.958764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.958764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.960447 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.960525 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.960525 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.960525 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.960947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.961037 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.961122 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.961195 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.961264 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.961389 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.961511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.961653 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.961809 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.961943 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.962080 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.962213 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.962347 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.962495 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.962650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.962787 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.962920 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.964092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.964251 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.964400 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.964547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.964768 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.964982 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.965171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.965330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.965476 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.965626 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.965783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.965941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.966097 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.966228 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.966386 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.966543 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.966712 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.966880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.967064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.967247 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.967363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.967482 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.967616 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.967753 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.967886 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.968020 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.968165 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.968297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.968456 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.968601 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.968747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.968899 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.969045 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.969201 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.969370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.969508 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.969625 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.969699 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.969774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.969850 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.969928 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970004 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970004 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970156 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970235 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970350 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970461 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970580 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970686 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970686 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.970982 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.971123 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.971247 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.971355 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.971436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.971512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.971617 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.971846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.971938 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.972170 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.972309 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.972511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.972618 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.972817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.972906 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.973132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.973223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.973451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.973599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.973766 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.973857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.974079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.974176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.974378 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.974496 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.974696 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.974835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.975071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.975222 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.975375 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.975472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.975678 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.975770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.975983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.976080 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.976292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.976390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.976602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.976699 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.976913 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.977002 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.977221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.977312 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.977535 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.977633 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.977852 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.978068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.978170 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.978395 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.978533 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.978802 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.979039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.979197 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.979362 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.979661 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.979857 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.980251 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.980420 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.980720 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.980960 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.981175 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.981528 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.981820 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.982112 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.982219 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.982565 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.982669 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.983247 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.983346 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.983755 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.983866 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.984384 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.984589 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.984768 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.984933 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.985427 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.985560 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.985837 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.985959 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.986651 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.986780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.986889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.986889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.987091 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.987260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.987588 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.987754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.987949 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.988200 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.988457 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.988788 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.989129 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.989402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.989652 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.989951 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.990254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.990513 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.990813 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.991138 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.991397 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.991628 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.991789 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.991974 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.992218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.992493 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.992743 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.992743 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.993242 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.993505 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.993767 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.993767 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.994249 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.994557 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.994825 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.995116 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.995346 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.995525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.995685 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.995836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.996000 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.996158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.996326 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.996486 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.996646 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.996805 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.996957 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.997106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.997265 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.997416 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.997567 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.997718 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.997875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.998037 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.998197 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.998347 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.998497 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.998657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.998809 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.998968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.999156 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.999317 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.999475 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.999626 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.999785 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:59.999951 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.000121 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.000272 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.000430 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.000430 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.000717 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.000882 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.001042 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.001193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.001193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.001477 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.001634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.001634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.001932 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.002092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.002092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.002385 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.002559 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.002559 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.002856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.003030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.003199 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.003352 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.003352 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.003647 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.003806 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.003964 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.004125 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.004125 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.004421 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.004572 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.004572 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.004934 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.005096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.005247 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.005407 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.005407 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.005695 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.005846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.005846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.006169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.006864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.006864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.007205 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.007357 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.007357 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.007670 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.007822 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.007822 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.008108 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.008265 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.008424 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.008596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.008596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.008897 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.009049 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.009049 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.009344 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.009553 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.009553 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.009850 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.010008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.010160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.010318 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.010476 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.010641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.010798 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.010949 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.011135 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.011300 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.011452 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.011601 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.011751 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.011751 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.012036 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.012195 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.012376 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.012544 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.012704 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.012966 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.013303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.013589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.013747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.014499 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.015377 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.015874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.016147 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.016648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.017514 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.017514 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.018556 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.018836 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.018836 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.019176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.019372 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.019372 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.019874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.020202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.020202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.020852 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.021589 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.021589 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.025194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.025389 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.025389 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.025706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.025859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.026769 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.026956 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.027150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.027308 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.027461 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.027620 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.027620 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.028320 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.028482 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.028482 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.028784 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.028943 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.029111 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.029271 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.029422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.029572 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.029722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.029873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.029873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.030171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.030322 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.030502 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.030655 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.030655 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.030952 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.031155 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.031155 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.031446 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.031611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.031611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.031917 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.032069 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.032229 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.032380 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.032380 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.032380 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.032911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.033071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.033071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.033387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.033556 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.033710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.033868 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.033868 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.034155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.034306 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.034466 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.034637 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.034797 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.034949 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.035216 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.035383 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.035383 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.035727 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.035869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036139 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036282 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036663 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036915 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.036915 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.037058 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.037189 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.037265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.037368 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.037861 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.037946 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038018 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038088 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038088 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038436 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038590 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038660 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038789 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.038910 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.039081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.039081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.039357 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.039467 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.039544 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.039624 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.039695 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.039764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.039881 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040027 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040152 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040324 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040402 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040402 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040543 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.040905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.041045 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.042321 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.042469 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.042469 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.042759 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.042937 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.043150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.043296 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.043296 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.043581 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.043734 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.043734 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.044072 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.044235 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.044392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.044552 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.044552 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.044848 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.045012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.045204 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.045369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.045524 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.045685 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.045854 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.045996 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046103 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046424 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046613 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046697 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046780 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046872 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.046965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047139 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047139 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047519 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047597 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047809 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.047949 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048017 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048017 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048149 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048226 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048304 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048376 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048376 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048515 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048721 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048797 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.048958 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.049039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.049111 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.049369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.049466 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.049688 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.049794 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.050010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.050183 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.050331 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.050512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.050652 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.050840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.050984 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.051179 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.051332 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.051503 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.051627 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.051832 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.051936 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.052235 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.052343 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.052427 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.052662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.052758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.052935 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.053029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.053373 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.053511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.053597 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.053829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.053925 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.054115 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.054218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.054417 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.054570 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.054722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.054879 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.055053 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.055210 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.055376 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.055529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.055679 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.055829 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.055987 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.056145 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.056305 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.056468 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.056625 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.056783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.056941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.057107 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.057258 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.057410 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.057560 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.057718 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.057875 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.058040 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.058193 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.058386 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.058559 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.058720 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.058882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.059083 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.059250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.059401 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.059579 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.059772 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.059966 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.060130 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.060290 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.060442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.060605 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.060762 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.060927 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.061080 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.061230 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.061387 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.061387 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.061685 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.061848 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.061999 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.062151 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.062308 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.062459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.062619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.062796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.062957 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.063134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.063286 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.063436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.063587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.063751 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.063911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.064069 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.064221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.064379 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.064554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.064714 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.064866 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.065023 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.065174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.065325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.065484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.065636 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.065795 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.065946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.066103 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.066262 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.066426 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.066600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.066752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.066910 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.067094 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.067263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.067481 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.067688 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.067853 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.068028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.068136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.068244 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.068335 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.068422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.068507 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.068599 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.069256 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.069624 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.069802 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.069955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.070107 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.070259 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.070385 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.070473 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.070554 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.070627 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.070858 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.070957 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.071199 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.071286 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.071515 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.071781 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.071869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.071969 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.072305 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.072636 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.072721 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.072803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.072884 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.073051 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.073386 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.073599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.073778 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.073953 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.074116 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.074303 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.074459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.074535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.074774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.074979 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.075237 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.075447 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.075576 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.075659 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.075919 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.076005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.076109 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.076240 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.076333 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.076561 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.076646 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.076884 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.076975 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.077216 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.077305 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.077529 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.077611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.077840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.077936 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.078150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.078231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.078460 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.078540 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.078766 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.078862 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.079184 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.079281 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.079516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.079610 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.079847 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.080013 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.080174 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.080255 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.080488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.080568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.080828 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.081032 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.081161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.081385 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.081481 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.081703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.081978 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.082073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.082164 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.082729 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.082836 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.082931 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.083049 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.083138 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.083223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.083306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.083398 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.083640 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.083803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.083950 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.084178 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.084328 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.085129 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.085309 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.085477 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.085636 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.085791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.085891 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.086070 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.086253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.086418 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.086519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.086704 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.086807 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.087136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.087261 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.087339 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.087558 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.087660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.087745 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.087966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.088069 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.088296 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.088397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.088607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.088713 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.088947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.089044 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.089265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.089362 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.089573 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.089679 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.089882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.089980 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.090190 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.090287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.090528 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.090629 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.090824 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.090925 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.091152 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.091258 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.091441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.091534 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.091876 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.091983 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.092068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.092142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.092398 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.092509 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.092686 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.092787 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.093014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.093119 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.093331 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.093443 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.093638 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.093736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.093946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.094052 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.094265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.094521 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.094620 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.094859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.094965 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.095210 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.095309 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.095522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.095619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.095840 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.095944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.096160 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.096268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.096483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.096710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.096807 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.097045 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.097150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.097367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.097480 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.097703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.097808 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.098035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.098132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.098341 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.098445 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.098647 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.098750 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.098951 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.099162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.099323 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.099478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.099672 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.099775 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.099982 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.100113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.100311 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.100485 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.100676 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.100775 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.101000 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.101098 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.101316 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.101415 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.101640 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.101738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.102003 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.102106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.102295 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.102397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.102590 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.102693 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.102907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.103126 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.103279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.103371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.103547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.103649 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.103862 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.103961 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.104178 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.104275 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.104501 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.104609 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.104822 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.104981 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.105132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.105291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.105442 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.105604 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.105764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.105921 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.106079 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.106230 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.106390 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.106554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.106707 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.106858 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.107055 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.107255 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.107432 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.107595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.107748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.107898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.108046 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.108232 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.108398 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.108567 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.108719 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.108890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.109041 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.109192 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.109350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.109502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.109653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.109811 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.109962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.110247 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.110412 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.110577 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.110743 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.110897 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.111085 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.111260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.111414 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.111572 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.111731 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.111891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.112062 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.112300 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.112466 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.112624 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.112787 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.112947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.113106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.113106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.113403 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.113562 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.113713 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.113862 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.114022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.114174 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.114330 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.114481 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.114649 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.114800 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.114800 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.115137 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.115291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.115517 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.115784 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.116030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.116292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.116473 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.116627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.116778 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.116928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.117104 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.117104 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.117394 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.117552 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.117704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.117855 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.117855 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.118157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.118316 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.118470 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.118619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.118777 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.118942 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119347 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119439 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119535 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119814 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.119993 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.120175 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.120277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.120488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.120588 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.120799 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.120924 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.121108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.121199 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.121421 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.121502 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.121739 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.121865 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.122053 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.122146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.122374 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.122490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.122793 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.123101 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.123216 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.123292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.123361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.123438 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.123673 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.123780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.123993 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.124084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.124331 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.124636 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.124725 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.124949 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.125078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.125274 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.125401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.125594 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.125722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.125924 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.126236 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.126338 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.126551 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.126790 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.126907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.127259 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.127367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.127687 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.127823 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.128028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.128166 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.128442 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.128538 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.128686 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.128819 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.129022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.129158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.129347 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.129472 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.129702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.129790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.130027 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.130118 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.130343 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.130434 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.130711 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.130801 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.131031 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.131163 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.131897 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.132039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.132316 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.132438 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.132596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.132737 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.132821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.133113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.133216 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.133443 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.133549 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.133763 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.133884 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.134156 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.134263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.134449 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.134552 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.134736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.134885 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.135073 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.135241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.135411 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.135570 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.135726 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.135882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.136033 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.136198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.136358 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.136508 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.136664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.136820 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.136984 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.137136 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.137294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.137445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.137593 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.137748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.137905 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.138074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:42:00.138226 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.138460 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.138799 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.139148 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.139461 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.139894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.140217 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.140545 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.140976 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.141294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.141588 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.141874 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.142160 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.142493 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.143974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.143974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.143974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.143974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.144754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.144754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.144754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.145172 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.145330 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.145639 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.145956 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.146271 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.146581 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.146963 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.147793 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.148109 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.148421 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.148731 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.149046 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.149609 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.149919 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.150228 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.150537 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.150847 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.151183 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.151499 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.151809 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.152120 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.152429 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.152742 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.153062 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.153399 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.153738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.154159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.154426 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.154695 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.155048 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.155369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.155700 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.156032 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.156360 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.156679 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.157022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.157343 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.157666 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.157996 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.158315 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.158629 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.158950 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.159316 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.159652 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.159969 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.160303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.160625 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.160955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.161279 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.161598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.161938 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.162258 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.162679 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.162981 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.163327 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.163648 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.163977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.164304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.164643 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.164979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.165297 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.165630 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.166936 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.166936 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.166936 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.167478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.167478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.167892 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.168043 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.168238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:00.168541 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:42:00.205918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO dbcounter [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Registered counter for database nova_api Jun 15 14:42:00.228467 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_db.sqlalchemy.engines [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:00.233839 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO dbcounter [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Registered counter for database nova_api Jun 15 14:42:00.236945 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writer thread running {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:00.254777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_db.sqlalchemy.engines [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:00.262940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writer thread running {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:00.297208 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.context [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),095ba511-08d8-4454-8c74-3289cb8a8527(cell1) {{(pid=124178) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:42:00.302413 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:00.304166 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:00.306916 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:00.306916 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:00.309128 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO dbcounter [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Registered counter for database nova_cell0 Jun 15 14:42:00.313192 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO dbcounter [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Registered counter for database nova_cell1 Jun 15 14:42:00.322126 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_db.sqlalchemy.engines [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:00.324487 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_db.sqlalchemy.engines [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:00.327133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.context [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),095ba511-08d8-4454-8c74-3289cb8a8527(cell1) {{(pid=124179) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:42:00.331476 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writer thread running {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:00.331829 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:00.333540 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:00.334668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:00.336907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:00.339172 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO dbcounter [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Registered counter for database nova_cell0 Jun 15 14:42:00.343486 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO dbcounter [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Registered counter for database nova_cell1 Jun 15 14:42:00.352132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_db.sqlalchemy.engines [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:00.353516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_db.sqlalchemy.engines [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:00.359910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writer thread running {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:00.362615 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writer thread running {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:00.485539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writer thread running {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:00.495946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO dbcounter [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Registered counter for database nova_cell0 Jun 15 14:42:00.504012 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_db.sqlalchemy.engines [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:00.510026 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writer thread running {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:00.525213 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO dbcounter [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Registered counter for database nova_cell0 Jun 15 14:42:00.532441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_db.sqlalchemy.engines [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:00.538291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writer thread running {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:00.845898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: WARNING keystonemiddleware.auth_token [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:42:00.853365 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: WARNING keystonemiddleware.auth_token [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:42:00.865211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: WARNING keystonemiddleware.auth_token [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:42:00.872615 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: WARNING keystonemiddleware.auth_token [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:42:01.211139 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: WARNING keystonemiddleware.auth_token [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:42:01.217285 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: WARNING keystonemiddleware.auth_token [None req-90c427a3-5784-4261-8b98-f65b138e82a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:42:01.221131 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: WARNING keystonemiddleware.auth_token [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:42:01.222684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555c65aa29c0 pid: 124178 (default app) Jun 15 14:42:01.228172 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: WARNING keystonemiddleware.auth_token [None req-acbfcbfa-a1d0-442e-9ef4-aeb004666409 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:42:01.233804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555c65aa29c0 pid: 124179 (default app) Jun 15 14:42:43.122146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:43.123193 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:43.124193 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:43.124991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:43.863857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:43.870344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:43.872144 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:43.874627 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:44.957287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-390f5667-3f43-40e7-a524-f8a628dddb73 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] Action: 'create', calling method: .version_select at 0x7f05bd782790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1925437188", "metadata": {"Type": "work"}}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:44.967478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1fb78ec4-8bb3-4949-ab43-bbfa28150457 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Action: 'create', calling method: .version_select at 0x7f05bd781820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1349045576"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:46.816259 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-390f5667-3f43-40e7-a524-f8a628dddb73 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.958356 Jun 15 14:42:46.817596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Jun 15 14:42:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2961 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 14:42:46.935883 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1821098834", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "networks": [{"uuid": "6b5bd6bc-763c-4d43-8198-253ad0d53e59"}]}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:46.963661 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1fb78ec4-8bb3-4949-ab43-bbfa28150457 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.859087 Jun 15 14:42:46.964398 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 1/2] 10.222.0.45 () {60 vars in 1154 bytes} [Wed Jun 15 14:42:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3862 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 14:42:46.972284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a59d03a0-8866-4447-82c1-99b846993b88 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bd648670>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:47.190174 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a59d03a0-8866-4447-82c1-99b846993b88 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/9ab29899-6dd2-4174-9f78-ea69f4df39b4" status: 200 len: 350 microversion: 2.1 time: 0.224576 Jun 15 14:42:47.191056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:42:46 2022] GET /compute/v2.1/os-volumes/9ab29899-6dd2-4174-9f78-ea69f4df39b4 => generated 350 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:47.206642 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-616ca83f-daa3-49a1-8f88-e3d547c1cd46 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] Calling method '.version_select at 0x7f05bd648790>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:47.326857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] validate_networks() for [('6b5bd6bc-763c-4d43-8198-253ad0d53e59', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:42:47.408184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-616ca83f-daa3-49a1-8f88-e3d547c1cd46 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c" status: 200 len: 354 microversion: 2.1 time: 0.215624 Jun 15 14:42:47.414971 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:42:47 2022] GET /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c => generated 354 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:47.421087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6443609c-7698-440c-a35b-51fe93888621 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bd648ee0>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:47.528168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6443609c-7698-440c-a35b-51fe93888621 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9" status: 200 len: 345 microversion: 2.1 time: 0.108772 Jun 15 14:42:47.528168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 4/5] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:42:47 2022] GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:47.528168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-459a382c-8f69-4eeb-b0ca-98c8fc6cb2e1 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] Calling method '.version_select at 0x7f05bd65b5e0>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:47.663692 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-459a382c-8f69-4eeb-b0ca-98c8fc6cb2e1 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c" status: 200 len: 354 microversion: 2.1 time: 0.142275 Jun 15 14:42:47.666026 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 5/6] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:42:47 2022] GET /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:47.685606 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b12eeb1d-8cda-4802-9f7a-71c9dcd781a0 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] Calling method '.version_select at 0x7f05bd648c10>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:47.842286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b12eeb1d-8cda-4802-9f7a-71c9dcd781a0 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c" status: 202 len: 0 microversion: 2.1 time: 0.161728 Jun 15 14:42:47.845633 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 6/7] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 14:42:47 2022] DELETE /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:42:47.853483 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-83dccc80-9e32-43db-b768-9a173a9b0e27 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] Calling method '.version_select at 0x7f05bd648b80>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:47.965029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-83dccc80-9e32-43db-b768-9a173a9b0e27 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c" status: 200 len: 353 microversion: 2.1 time: 0.118062 Jun 15 14:42:47.966923 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 7/8] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:42:47 2022] GET /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:48.533359 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1639f6c4-d057-4660-a228-8a296570e84d tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bd65b310>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:48.653163 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1639f6c4-d057-4660-a228-8a296570e84d tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9" status: 200 len: 346 microversion: 2.1 time: 0.123675 Jun 15 14:42:48.654633 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 8/9] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:42:48 2022] GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 => generated 346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:42:48.672917 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-76b32f4d-710d-4063-ad80-6d8b3bf60f0b tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Action: 'create', calling method: .version_select at 0x7f05bd648940>, body: {"snapshot": {"volume_id": "22ee8d01-360d-4448-ae71-f4c666e70ed9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1149136901"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:49.133816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-76b32f4d-710d-4063-ad80-6d8b3bf60f0b tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.470692 Jun 15 14:42:49.134820 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 9/10] 10.222.0.45 () {60 vars in 1161 bytes} [Wed Jun 15 14:42:48 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:42:49.172087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ce80ddcf-535f-450c-99b4-303630039a68 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] Calling method '.version_select at 0x7f05bd65b1f0>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:49.367342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-ce80ddcf-535f-450c-99b4-303630039a68 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] HTTP exception thrown: Volume fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c could not be found. Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ce80ddcf-535f-450c-99b4-303630039a68 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] Request method failure captured: Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c HTTP/1.1 Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_jt8IuyIB4YsgaCCwakMKfniALIXSDxdhCjPxsqxhAI4fGF1ZUdM7sjjzdNOM9PuzSsKTuDJzy9NQ-94kq517klRQ5oi1Jj8I0l46suQNEYVOvZnfUMPqDVsC-L95gOPDiXZswKEEYXHG94Fjmxs-ryyRtsJXWGHawBN8x5BAO3Ew Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: da762c4e79d14510afd0a35251c4bad3 Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-VolumesGetTestJSON-1629257042 Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:42:49.372134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da762c4e79d14510afd0a35251c4bad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da762c4e79d14510afd0a35251c4bad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da762c4e79d14510afd0a35251c4bad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da762c4e79d14510afd0a35251c4bad3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-VolumesGetTestJSON-1629257042 Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: da762c4e79d14510afd0a35251c4bad3 Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-VolumesGetTestJSON-1629257042 Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-VolumesGetTestJSON-1629257042-project Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 9202dcd0010f4727b9a4966a5793db78 Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-VolumesGetTestJSON-1629257042-project Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Volume fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c could not be found. Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': 'fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c'} Jun 15 14:42:49.374220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c could not be found. (HTTP 404) (Request-ID: req-957f7033-ce54-4c9d-bff4-2545dd9ffa3b) Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:42:49.376372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:42:49.380087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c could not be found. Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:42:49.386401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c could not be found. Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c could not be found. Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ce80ddcf-535f-450c-99b4-303630039a68 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] Returning 404 to user: Volume fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ce80ddcf-535f-450c-99b4-303630039a68 tempest-VolumesGetTestJSON-1629257042 tempest-VolumesGetTestJSON-1629257042-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c" status: 404 len: 109 microversion: 2.1 time: 0.235866 Jun 15 14:42:49.394519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 10/11] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:42:49 2022] GET /compute/v2.1/os-volumes/fc2cf4bf-1dcc-4d72-9553-3c1859cd4a7c => generated 109 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:42:49.414748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ebee8299-374a-4121-b37d-eaf3c517e48f tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bd5cf0d0>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:49.509185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ebee8299-374a-4121-b37d-eaf3c517e48f tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.131855 Jun 15 14:42:49.509877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 11/12] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:49 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:49.515996 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-553d3ffd-7f3b-4e4a-ba36-4f0c56a60bf0 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bd5cf820>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:49.643764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-553d3ffd-7f3b-4e4a-ba36-4f0c56a60bf0 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/60f00c5b-eaa5-4ed7-9e68-1eb83c8781c0" status: 200 len: 351 microversion: 2.1 time: 0.132702 Jun 15 14:42:49.644378 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 12/13] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:42:49 2022] GET /compute/v2.1/os-volumes/60f00c5b-eaa5-4ed7-9e68-1eb83c8781c0 => generated 351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:49.656619 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-39797fc5-cc3b-4bae-8e46-9ad11b88b3bb tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bd5cfc10>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:49.764490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-39797fc5-cc3b-4bae-8e46-9ad11b88b3bb tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.118952 Jun 15 14:42:49.765065 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 13/14] 10.222.0.45 () {58 vars in 1139 bytes} [Wed Jun 15 14:42:49 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:49.778211 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-30437958-804f-4c7c-94c1-8fada56c0a82 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bd5cf310>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:49.800503 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:42:49.801821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:42:49.802323 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:42:49.804628 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:42:49.805113 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:42:49.879210 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:49.880604 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:49.885555 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:49.889072 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:50.034411 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-30437958-804f-4c7c-94c1-8fada56c0a82 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.261912 Jun 15 14:42:50.034973 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 14/15] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:49 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:42:50.050522 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Getting quotas for project f35be82fde6249bab9008a41cd7ce8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:42:50.085419 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Getting quotas for user e452beb1eaf540daa9bbfec92e3138cb and project f35be82fde6249bab9008a41cd7ce8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:42:50.119415 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:42:50.137800 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:42:50.330442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f0b5fbf2-22f5-4537-92ea-30719585b9f4 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.511491 Jun 15 14:42:50.332725 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 2/16] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:42:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:42:50.346121 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-171aee75-d700-4304-a75e-cf540aac40d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:50.348534 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-171aee75-d700-4304-a75e-cf540aac40d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:42:50.668975 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-171aee75-d700-4304-a75e-cf540aac40d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:42:50.706866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-171aee75-d700-4304-a75e-cf540aac40d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1215 microversion: 2.1 time: 0.364566 Jun 15 14:42:50.711535 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 15/17] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:42:50 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1215 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:51.054585 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e6d06fe9-9a1b-48f3-b863-380771d2f167 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc4f9160>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:51.174890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e6d06fe9-9a1b-48f3-b863-380771d2f167 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.128778 Jun 15 14:42:51.175780 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 3/18] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:51 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:42:51.762053 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f8d6e408-5685-4441-add4-2972f4eeddb7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:51.762816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f8d6e408-5685-4441-add4-2972f4eeddb7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:42:52.090500 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f8d6e408-5685-4441-add4-2972f4eeddb7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:42:52.104679 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f8d6e408-5685-4441-add4-2972f4eeddb7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1215 microversion: 2.1 time: 0.368204 Jun 15 14:42:52.107155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 16/19] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:42:51 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1215 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:52.190022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-67373a0a-ef5d-409b-9dbe-186bd6c8154c tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc4f98b0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:52.265938 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-67373a0a-ef5d-409b-9dbe-186bd6c8154c tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.080580 Jun 15 14:42:52.272215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 4/20] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:52 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:53.125286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9f96e2ff-a5da-4e00-be99-bc06ac6e5dcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:53.128330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9f96e2ff-a5da-4e00-be99-bc06ac6e5dcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:42:53.168781 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9f96e2ff-a5da-4e00-be99-bc06ac6e5dcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:53.169281 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9f96e2ff-a5da-4e00-be99-bc06ac6e5dcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:53.175936 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9f96e2ff-a5da-4e00-be99-bc06ac6e5dcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:53.181402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9f96e2ff-a5da-4e00-be99-bc06ac6e5dcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:53.282266 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6e0a1327-29d7-43eb-8e71-f7291cadfc5c tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bd558ee0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:53.394869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6e0a1327-29d7-43eb-8e71-f7291cadfc5c tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.119635 Jun 15 14:42:53.402537 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 5/21] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:53 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:53.774706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9f96e2ff-a5da-4e00-be99-bc06ac6e5dcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:42:53.812308 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9f96e2ff-a5da-4e00-be99-bc06ac6e5dcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1219 microversion: 2.1 time: 0.692390 Jun 15 14:42:53.813496 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 17/22] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:42:53 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1219 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:54.419285 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-19aa0d6e-bccd-46c9-9372-950d02d2c87c tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc4f93a0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:54.515132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-19aa0d6e-bccd-46c9-9372-950d02d2c87c tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.109053 Jun 15 14:42:54.515935 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 6/23] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:54 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:54.833376 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d6813d54-2245-4b25-877c-d915b69fdc90 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:54.834390 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d6813d54-2245-4b25-877c-d915b69fdc90 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:42:54.860651 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d6813d54-2245-4b25-877c-d915b69fdc90 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:54.861110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d6813d54-2245-4b25-877c-d915b69fdc90 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:54.861903 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d6813d54-2245-4b25-877c-d915b69fdc90 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:54.863218 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d6813d54-2245-4b25-877c-d915b69fdc90 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:55.217279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d6813d54-2245-4b25-877c-d915b69fdc90 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:42:55.226665 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d6813d54-2245-4b25-877c-d915b69fdc90 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1219 microversion: 2.1 time: 0.400824 Jun 15 14:42:55.228832 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 18/24] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:42:54 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1219 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:55.529707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d9df06ae-44a7-4c44-8c7e-8d281d0b9fa4 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc4f9f70>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:55.595578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d9df06ae-44a7-4c44-8c7e-8d281d0b9fa4 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.070315 Jun 15 14:42:55.596737 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 7/25] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:55 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:56.256728 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6c783dcb-ce85-4a79-a61a-996f0dc532d1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:56.257442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6c783dcb-ce85-4a79-a61a-996f0dc532d1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:42:56.306978 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6c783dcb-ce85-4a79-a61a-996f0dc532d1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:56.307492 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6c783dcb-ce85-4a79-a61a-996f0dc532d1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:56.313365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6c783dcb-ce85-4a79-a61a-996f0dc532d1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:56.314379 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6c783dcb-ce85-4a79-a61a-996f0dc532d1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:56.737768 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1327164199", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:57.074070 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] validate_networks() for [('d78101b2-2eb1-45aa-8dfb-f4f7bbd1e980', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:42:57.184585 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6c783dcb-ce85-4a79-a61a-996f0dc532d1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:42:57.251915 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6c783dcb-ce85-4a79-a61a-996f0dc532d1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1219 microversion: 2.1 time: 0.999434 Jun 15 14:42:57.253244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 8/26] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:42:56 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1219 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:57.273216 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a9b9da32-a206-4c30-bf5a-3318f0341674 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc4835e0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:57.533596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a9b9da32-a206-4c30-bf5a-3318f0341674 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 288 microversion: 2.1 time: 0.268547 Jun 15 14:42:57.545821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 9/27] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:57 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 288 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:57.565152 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f654238a-b090-448c-aa0f-04924b877f17 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc48a670>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:57.742910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f654238a-b090-448c-aa0f-04924b877f17 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 202 len: 0 microversion: 2.1 time: 0.194767 Jun 15 14:42:57.743710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 10/28] 10.222.0.45 () {58 vars in 1253 bytes} [Wed Jun 15 14:42:57 2022] DELETE /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:42:57.753544 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-292e0367-e75d-41ca-860c-860df9c6e464 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc49e4c0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:57.835650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-292e0367-e75d-41ca-860c-860df9c6e464 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.087244 Jun 15 14:42:57.837165 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 11/29] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:57 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:58.238879 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-952ab616-d59a-47df-a1a6-8702cfa8157a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'create', calling method: .version_select at 0x7f05bc48aee0>, body: {"keypair": {"name": "tempest-keypair-790703021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8ouUTgSkgURcJuWBW1kw4MKqsfQOA0zGnYfXqIQYVub07KxXIzrzpAUuAF5GR7GIJNDAg8lX5M4GrIbO6bTVkcVBDqkHczp1mW2ui2T7hTq9X95a8RCt2OpbQpa9pUJQ=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:58.307647 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-952ab616-d59a-47df-a1a6-8702cfa8157a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Getting quotas for project 6d3ce7cecd2f4983b8442f70ed2afdb1. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:42:58.322818 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-952ab616-d59a-47df-a1a6-8702cfa8157a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Getting quotas for user 1efb0951ba1144d58698e02e0e5e9416 and project 6d3ce7cecd2f4983b8442f70ed2afdb1. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:42:58.401404 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-952ab616-d59a-47df-a1a6-8702cfa8157a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.284045 Jun 15 14:42:58.403538 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 12/30] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 14:42:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:58.417729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9b09092b-bc1c-4d5f-83d3-7beb93898fff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:58.418308 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9b09092b-bc1c-4d5f-83d3-7beb93898fff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:42:58.427471 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b09092b-bc1c-4d5f-83d3-7beb93898fff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:58.428328 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b09092b-bc1c-4d5f-83d3-7beb93898fff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:58.429510 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b09092b-bc1c-4d5f-83d3-7beb93898fff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:58.431185 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b09092b-bc1c-4d5f-83d3-7beb93898fff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:58.636812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9b09092b-bc1c-4d5f-83d3-7beb93898fff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:42:58.668527 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9b09092b-bc1c-4d5f-83d3-7beb93898fff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1211 microversion: 2.1 time: 0.261010 Jun 15 14:42:58.678889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 13/31] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:42:58 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1211 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:58.861299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-87b0d08d-1dae-43b8-a80a-c41c9d67a22b tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc43caf0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:58.885188 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:42:58.886299 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:42:58.886975 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:42:58.888236 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:42:58.888945 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:42:58.929878 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:58.931336 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:58.932623 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:58.933225 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:58.967024 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-87b0d08d-1dae-43b8-a80a-c41c9d67a22b tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.120359 Jun 15 14:42:58.971165 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 14/32] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:42:58 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:59.024180 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Getting quotas for project a243ba2c3f774c10b77a052075497b92. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:42:59.048200 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Getting quotas for user c9a3a2e49fee4ea08ca790006d0b29e4 and project a243ba2c3f774c10b77a052075497b92. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:42:59.064766 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:42:59.068653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:42:59.217285 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5ff7d4df-791f-4155-8d2c-dc154b80d8df tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.986067 Jun 15 14:42:59.221833 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 19/33] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:42:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:42:59.245622 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-24c40f95-a2a6-479b-bd08-280dcd5abbc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:59.246452 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-24c40f95-a2a6-479b-bd08-280dcd5abbc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:42:59.357769 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-24c40f95-a2a6-479b-bd08-280dcd5abbc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:42:59.369904 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-24c40f95-a2a6-479b-bd08-280dcd5abbc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1222 microversion: 2.1 time: 0.137243 Jun 15 14:42:59.370974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 15/34] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:42:59 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:59.482439 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-98617145", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:59.493170 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a649c721-2e68-41c1-ae93-cab55fc74b15 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'create', calling method: .version_select at 0x7f05bd42a310>, body: {"keypair": {"name": "tempest-keypair-655202180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIrdMSuCmPTOIQ0YuTY7khUBsjt4QZZP5mkS3wxNCRc/IG4oTN3zXMvXS6uutgkMRAb2ao39+FRSEmV+2bstn774soefe1ciCnZQUjBOEq+lO9/YB1DGs5pj9OFq8LsmQ=="}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:59.532384 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-a649c721-2e68-41c1-ae93-cab55fc74b15 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Getting quotas for project 54d57ba7dd0d441b9748fc600bc34972. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:42:59.538275 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-a649c721-2e68-41c1-ae93-cab55fc74b15 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Getting quotas for user 25ba370b8daf49e48514cd49c2851215 and project 54d57ba7dd0d441b9748fc600bc34972. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:42:59.607727 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a649c721-2e68-41c1-ae93-cab55fc74b15 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.369781 Jun 15 14:42:59.608705 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 20/35] 10.222.0.45 () {62 vars in 1199 bytes} [Wed Jun 15 14:42:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 372 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 14:42:59.664407 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] validate_networks() for [('d78101b2-2eb1-45aa-8dfb-f4f7bbd1e980', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:42:59.700727 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-28da5eb0-2df1-4dbb-b0a0-c9d72bfbe293 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:59.701508 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-28da5eb0-2df1-4dbb-b0a0-c9d72bfbe293 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:42:59.717721 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28da5eb0-2df1-4dbb-b0a0-c9d72bfbe293 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:59.720778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28da5eb0-2df1-4dbb-b0a0-c9d72bfbe293 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:59.731769 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28da5eb0-2df1-4dbb-b0a0-c9d72bfbe293 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:59.737331 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28da5eb0-2df1-4dbb-b0a0-c9d72bfbe293 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:59.986683 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:00.201168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-28da5eb0-2df1-4dbb-b0a0-c9d72bfbe293 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:00.210020 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-28da5eb0-2df1-4dbb-b0a0-c9d72bfbe293 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1211 microversion: 2.1 time: 0.515057 Jun 15 14:43:00.223594 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 21/36] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:42:59 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1211 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:00.246691 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9dd09aec-1696-4359-bc33-79fdf01a365b tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bcbc48b0>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:00.300224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9dd09aec-1696-4359-bc33-79fdf01a365b tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.073271 Jun 15 14:43:00.301009 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 22/37] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:00 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:01.230333 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-930a855d-27a0-4f2b-98b2-26750e268626 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:01.231138 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-930a855d-27a0-4f2b-98b2-26750e268626 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:01.253879 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-930a855d-27a0-4f2b-98b2-26750e268626 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:01.254272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:43:01.254759 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-930a855d-27a0-4f2b-98b2-26750e268626 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:01.254846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:43:01.255289 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-930a855d-27a0-4f2b-98b2-26750e268626 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:01.256150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:43:01.256722 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:43:01.257520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-930a855d-27a0-4f2b-98b2-26750e268626 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:01.258098 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:43:01.290705 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:01.291383 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:01.294959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:01.296919 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:01.356559 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Getting quotas for project a243ba2c3f774c10b77a052075497b92. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:01.383438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Getting quotas for user c9a3a2e49fee4ea08ca790006d0b29e4 and project a243ba2c3f774c10b77a052075497b92. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:01.414649 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:43:01.423259 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:43:01.468726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-930a855d-27a0-4f2b-98b2-26750e268626 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:01.483476 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-930a855d-27a0-4f2b-98b2-26750e268626 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1267 microversion: 2.1 time: 0.251689 Jun 15 14:43:01.484368 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 23/38] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:01 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:01.511268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-23f3642f-1ac5-4f76-b71e-6a071cbb1423 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc380430>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:01.572480 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-29c7fd5f-b3f7-449f-8a95-4769e1ed00f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.103379 Jun 15 14:43:01.576451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 16/39] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:42:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:43:01.594919 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-23f3642f-1ac5-4f76-b71e-6a071cbb1423 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 200 len: 287 microversion: 2.1 time: 0.104760 Jun 15 14:43:01.595609 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 24/40] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:01 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:01.597859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1f39b12d-eeba-475c-ae30-a34721f3ef18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:01.600729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1f39b12d-eeba-475c-ae30-a34721f3ef18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:01.980558 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1f39b12d-eeba-475c-ae30-a34721f3ef18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:02.003369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1f39b12d-eeba-475c-ae30-a34721f3ef18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1220 microversion: 2.1 time: 0.416906 Jun 15 14:43:02.004793 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 17/41] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:01 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1220 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:02.501782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8caa2d43-3a7a-466c-a7c5-561a4be59513 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:02.502647 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8caa2d43-3a7a-466c-a7c5-561a4be59513 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:02.537441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8caa2d43-3a7a-466c-a7c5-561a4be59513 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:02.540416 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8caa2d43-3a7a-466c-a7c5-561a4be59513 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:02.548056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8caa2d43-3a7a-466c-a7c5-561a4be59513 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:02.548780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8caa2d43-3a7a-466c-a7c5-561a4be59513 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:02.610008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2c9bd594-7090-4731-a344-0159fb0c6dc0 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc43c790>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:02.742177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-2c9bd594-7090-4731-a344-0159fb0c6dc0 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] HTTP exception thrown: Snapshot 7e6b0a83-d2df-4b7e-bc86-61a808a3db11 could not be found. Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2c9bd594-7090-4731-a344-0159fb0c6dc0 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Request method failure captured: Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 HTTP/1.1 Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_in9TwHuzjUiiFbC8hyoERF6IYqz8V3Qsjjq9S1nt7SaynXoiJ9eoX0k0SD1QR0WB78LpLCKZIsEWjmUspiPvF5mMOD-CbCdPpjNA5rmHcObuQbl_7UsuLrLx-LNVhH_SdM-GwQ0svGtHXYubVXb3qO3Nn6J-NACjLO22Gqas_T4Y Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: c1f8a1b95df743588b298fe0efbcd967 Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:43:02.746767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: c1f8a1b95df743588b298fe0efbcd967 Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesSnapshotsTestJSON-570803590-project Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 627ebb2f052145cb8a009e1009d15da7 Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-570803590-project Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Snapshot 7e6b0a83-d2df-4b7e-bc86-61a808a3db11 could not be found. Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '7e6b0a83-d2df-4b7e-bc86-61a808a3db11'} Jun 15 14:43:02.748508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7e6b0a83-d2df-4b7e-bc86-61a808a3db11 could not be found. (HTTP 404) (Request-ID: req-d096d92a-3411-47b1-82db-27739cb5314f) Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:02.749366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:02.750592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7e6b0a83-d2df-4b7e-bc86-61a808a3db11 could not be found. Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 14:43:02.751821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7e6b0a83-d2df-4b7e-bc86-61a808a3db11 could not be found. Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7e6b0a83-d2df-4b7e-bc86-61a808a3db11 could not be found. Jun 15 14:43:02.752999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:02.753868 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2c9bd594-7090-4731-a344-0159fb0c6dc0 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Returning 404 to user: Snapshot 7e6b0a83-d2df-4b7e-bc86-61a808a3db11 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:02.755029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2c9bd594-7090-4731-a344-0159fb0c6dc0 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11" status: 404 len: 111 microversion: 2.1 time: 0.151379 Jun 15 14:43:02.758442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 18/42] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:02 2022] GET /compute/v2.1/os-snapshots/7e6b0a83-d2df-4b7e-bc86-61a808a3db11 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:43:02.772720 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5e91d3ea-4628-4387-af1e-c1fcfc1dc4d7 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05be031af0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:02.934850 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5e91d3ea-4628-4387-af1e-c1fcfc1dc4d7 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9" status: 202 len: 0 microversion: 2.1 time: 0.162190 Jun 15 14:43:02.934850 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 19/43] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 14:43:02 2022] DELETE /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:43:02.960406 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c7a763ee-c4fe-43d3-b8cc-7bc0138fe28a tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc43ce50>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:03.160925 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c7a763ee-c4fe-43d3-b8cc-7bc0138fe28a tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9" status: 200 len: 345 microversion: 2.1 time: 0.222445 Jun 15 14:43:03.167128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 20/44] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:02 2022] GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 => generated 345 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:03.184324 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-328d2f62-31d2-4905-9b08-cf3cdce3aa8a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:03.185150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-328d2f62-31d2-4905-9b08-cf3cdce3aa8a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:03.275057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-328d2f62-31d2-4905-9b08-cf3cdce3aa8a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:03.279631 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-328d2f62-31d2-4905-9b08-cf3cdce3aa8a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:03.293158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-328d2f62-31d2-4905-9b08-cf3cdce3aa8a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:03.295496 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-328d2f62-31d2-4905-9b08-cf3cdce3aa8a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:03.509756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8caa2d43-3a7a-466c-a7c5-561a4be59513 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:03.524633 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8caa2d43-3a7a-466c-a7c5-561a4be59513 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1273 microversion: 2.1 time: 1.027024 Jun 15 14:43:03.528337 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 25/45] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:02 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1273 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:03.606606 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-328d2f62-31d2-4905-9b08-cf3cdce3aa8a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:03.608950 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-694cf1bf-4c73-4124-963e-2a9a7332d2f4 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bc380820>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:03.665392 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-328d2f62-31d2-4905-9b08-cf3cdce3aa8a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1216 microversion: 2.1 time: 0.498516 Jun 15 14:43:03.684613 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 21/46] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:03 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1216 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:03.873887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-694cf1bf-4c73-4124-963e-2a9a7332d2f4 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/3a62b9ca-1341-4e6a-99d4-55ed79151a2c" status: 200 len: 351 microversion: 2.1 time: 0.267772 Jun 15 14:43:03.874495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 26/47] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:03 2022] GET /compute/v2.1/os-volumes/3a62b9ca-1341-4e6a-99d4-55ed79151a2c => generated 351 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:03.889276 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4aee3c9e-ba83-4232-ba7d-083609056808 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bc43c670>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:04.092406 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4aee3c9e-ba83-4232-ba7d-083609056808 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.203947 Jun 15 14:43:04.092406 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 22/48] 10.222.0.45 () {58 vars in 1133 bytes} [Wed Jun 15 14:43:03 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:04.104406 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-439cd1aa-52ef-476b-a462-710f1cf8ec44 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bc380af0>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:04.176740 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b2fee8f3-45b6-4339-9b71-22b9607ba576 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc470dc0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:04.475771 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-b2fee8f3-45b6-4339-9b71-22b9607ba576 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] HTTP exception thrown: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b2fee8f3-45b6-4339-9b71-22b9607ba576 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Request method failure captured: Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 HTTP/1.1 Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_in9TwHuzjUiiFbC8hyoERF6IYqz8V3Qsjjq9S1nt7SaynXoiJ9eoX0k0SD1QR0WB78LpLCKZIsEWjmUspiPvF5mMOD-CbCdPpjNA5rmHcObuQbl_7UsuLrLx-LNVhH_SdM-GwQ0svGtHXYubVXb3qO3Nn6J-NACjLO22Gqas_T4Y Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: c1f8a1b95df743588b298fe0efbcd967 Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:43:04.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: c1f8a1b95df743588b298fe0efbcd967 Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesSnapshotsTestJSON-570803590-project Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 627ebb2f052145cb8a009e1009d15da7 Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-570803590-project Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '22ee8d01-360d-4448-ae71-f4c666e70ed9'} Jun 15 14:43:04.480776 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. (HTTP 404) (Request-ID: req-dafad4cc-a345-4471-9a88-d1c3b6d360cc) Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:04.482299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:04.484204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:43:04.485846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b2fee8f3-45b6-4339-9b71-22b9607ba576 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Returning 404 to user: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:04.487554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b2fee8f3-45b6-4339-9b71-22b9607ba576 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9" status: 404 len: 109 microversion: 2.1 time: 0.309502 Jun 15 14:43:04.491200 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 23/49] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:04 2022] GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 => generated 109 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:43:04.499366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bbb517f3-ac31-49a0-a0bb-f1ed2b5cb125 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc3fd550>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:04.698126 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-439cd1aa-52ef-476b-a462-710f1cf8ec44 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.597916 Jun 15 14:43:04.699112 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 27/50] 10.222.0.45 () {58 vars in 1148 bytes} [Wed Jun 15 14:43:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:04.768296 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ca7f70f5-c079-43bc-96a3-a531e406fbf5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:04.769609 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ca7f70f5-c079-43bc-96a3-a531e406fbf5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:04.841663 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ca7f70f5-c079-43bc-96a3-a531e406fbf5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:04.845978 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ca7f70f5-c079-43bc-96a3-a531e406fbf5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:04.851972 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ca7f70f5-c079-43bc-96a3-a531e406fbf5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:04.855976 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ca7f70f5-c079-43bc-96a3-a531e406fbf5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:04.946602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-bbb517f3-ac31-49a0-a0bb-f1ed2b5cb125 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] HTTP exception thrown: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bbb517f3-ac31-49a0-a0bb-f1ed2b5cb125 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Request method failure captured: Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 HTTP/1.1 Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_in9TwHuzjUiiFbC8hyoERF6IYqz8V3Qsjjq9S1nt7SaynXoiJ9eoX0k0SD1QR0WB78LpLCKZIsEWjmUspiPvF5mMOD-CbCdPpjNA5rmHcObuQbl_7UsuLrLx-LNVhH_SdM-GwQ0svGtHXYubVXb3qO3Nn6J-NACjLO22Gqas_T4Y Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: c1f8a1b95df743588b298fe0efbcd967 Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:43:04.948876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: c1f8a1b95df743588b298fe0efbcd967 Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesSnapshotsTestJSON-570803590-project Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 627ebb2f052145cb8a009e1009d15da7 Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-570803590-project Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '22ee8d01-360d-4448-ae71-f4c666e70ed9'} Jun 15 14:43:04.950875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. (HTTP 404) (Request-ID: req-2b88337d-f4e0-44d9-beb6-579f1596227f) Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:04.952171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:43:04.955344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 14:43:04.959142 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bbb517f3-ac31-49a0-a0bb-f1ed2b5cb125 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Returning 404 to user: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bbb517f3-ac31-49a0-a0bb-f1ed2b5cb125 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9" status: 404 len: 109 microversion: 2.1 time: 0.457878 Jun 15 14:43:04.964515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 24/51] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 14:43:04 2022] DELETE /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 => generated 109 bytes in 468 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:43:04.985957 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8e701614-6680-444e-8bc9-bdec6f481206 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:04.986775 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8e701614-6680-444e-8bc9-bdec6f481206 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:05.035078 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e701614-6680-444e-8bc9-bdec6f481206 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:05.037512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e701614-6680-444e-8bc9-bdec6f481206 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:05.041541 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e701614-6680-444e-8bc9-bdec6f481206 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:05.046287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e701614-6680-444e-8bc9-bdec6f481206 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:05.612686 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8e701614-6680-444e-8bc9-bdec6f481206 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:05.627234 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ca7f70f5-c079-43bc-96a3-a531e406fbf5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:05.646802 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ca7f70f5-c079-43bc-96a3-a531e406fbf5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1273 microversion: 2.1 time: 0.927363 Jun 15 14:43:05.649089 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8e701614-6680-444e-8bc9-bdec6f481206 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1290 microversion: 2.1 time: 0.687557 Jun 15 14:43:05.650062 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 28/52] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:04 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1273 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:05.656356 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 25/53] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:04 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1290 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:05.690620 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-39066062-7521-4e97-81d3-3e237abf5465 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Calling method '.version_select at 0x7f05bc3ebe50>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:05.695383 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ed2ae88f-b0f4-433d-bb59-cef3d7b12255 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bc394af0>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:06.072163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-39066062-7521-4e97-81d3-3e237abf5465 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] HTTP exception thrown: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-39066062-7521-4e97-81d3-3e237abf5465 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Request method failure captured: Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 HTTP/1.1 Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_in9TwHuzjUiiFbC8hyoERF6IYqz8V3Qsjjq9S1nt7SaynXoiJ9eoX0k0SD1QR0WB78LpLCKZIsEWjmUspiPvF5mMOD-CbCdPpjNA5rmHcObuQbl_7UsuLrLx-LNVhH_SdM-GwQ0svGtHXYubVXb3qO3Nn6J-NACjLO22Gqas_T4Y Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: c1f8a1b95df743588b298fe0efbcd967 Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:43:06.075114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f8a1b95df743588b298fe0efbcd967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: c1f8a1b95df743588b298fe0efbcd967 Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-570803590 Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesSnapshotsTestJSON-570803590-project Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 627ebb2f052145cb8a009e1009d15da7 Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-570803590-project Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '22ee8d01-360d-4448-ae71-f4c666e70ed9'} Jun 15 14:43:06.076535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. (HTTP 404) (Request-ID: req-95d07994-cf60-4116-ad12-985eba511adb) Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:06.077365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:06.079483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:43:06.082269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. Jun 15 14:43:06.084953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:43:06.087478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ed2ae88f-b0f4-433d-bb59-cef3d7b12255 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.421598 Jun 15 14:43:06.087478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 29/54] 10.222.0.45 () {58 vars in 1133 bytes} [Wed Jun 15 14:43:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:06.102496 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-39066062-7521-4e97-81d3-3e237abf5465 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] Returning 404 to user: Volume 22ee8d01-360d-4448-ae71-f4c666e70ed9 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:06.104137 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-39066062-7521-4e97-81d3-3e237abf5465 tempest-VolumesSnapshotsTestJSON-570803590 tempest-VolumesSnapshotsTestJSON-570803590-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9" status: 404 len: 109 microversion: 2.1 time: 0.445692 Jun 15 14:43:06.105404 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 26/55] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:05 2022] GET /compute/v2.1/os-volumes/22ee8d01-360d-4448-ae71-f4c666e70ed9 => generated 109 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:43:06.122840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-345965552", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23f2c458-8df1-4b42-a46b-d86f08ca6185"}], "security_groups": [{"name": "tempest-securitygroup--1948507742"}], "key_name": "tempest-keypair-790703021", "user_data": "}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:06.152574 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-770712d0-af83-48c7-a6ba-4f1613ff5680 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bc384280>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:06.548958 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-770712d0-af83-48c7-a6ba-4f1613ff5680 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.441729 Jun 15 14:43:06.550473 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 27/56] 10.222.0.45 () {58 vars in 1166 bytes} [Wed Jun 15 14:43:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:06.570794 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-22035ce5-d97b-4e65-a031-8e04221050e0 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bc3ebdc0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:06.967453 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-22035ce5-d97b-4e65-a031-8e04221050e0 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.402494 Jun 15 14:43:06.968038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 28/57] 10.222.0.45 () {58 vars in 1169 bytes} [Wed Jun 15 14:43:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:06.980924 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-65562d66-e0f8-4fac-ab22-86424c24f507 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:06.983960 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-65562d66-e0f8-4fac-ab22-86424c24f507 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:07.032675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65562d66-e0f8-4fac-ab22-86424c24f507 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:07.033518 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65562d66-e0f8-4fac-ab22-86424c24f507 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:07.034377 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65562d66-e0f8-4fac-ab22-86424c24f507 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:07.037822 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65562d66-e0f8-4fac-ab22-86424c24f507 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:07.842333 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] validate_networks() for [('23f2c458-8df1-4b42-a46b-d86f08ca6185', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:43:07.965184 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-65562d66-e0f8-4fac-ab22-86424c24f507 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:07.986951 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-65562d66-e0f8-4fac-ab22-86424c24f507 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1273 microversion: 2.1 time: 1.017259 Jun 15 14:43:07.992517 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 29/58] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:06 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1273 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:08.002478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a3ca2041-a1e2-45a9-9304-ba69d7bcbb98 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:08.007020 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a3ca2041-a1e2-45a9-9304-ba69d7bcbb98 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:08.024371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a3ca2041-a1e2-45a9-9304-ba69d7bcbb98 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:08.025094 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a3ca2041-a1e2-45a9-9304-ba69d7bcbb98 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:08.027542 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a3ca2041-a1e2-45a9-9304-ba69d7bcbb98 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:08.030640 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a3ca2041-a1e2-45a9-9304-ba69d7bcbb98 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:08.291503 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a3ca2041-a1e2-45a9-9304-ba69d7bcbb98 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:08.322887 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a3ca2041-a1e2-45a9-9304-ba69d7bcbb98 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1278 microversion: 2.1 time: 0.326405 Jun 15 14:43:08.328695 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 30/59] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:07 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1278 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:08.347576 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a99c99ec-d95e-4f3f-bdce-a5abd9daee66 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bc399af0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:08.794682 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a99c99ec-d95e-4f3f-bdce-a5abd9daee66 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.463482 Jun 15 14:43:08.795548 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 31/60] 10.222.0.45 () {58 vars in 1154 bytes} [Wed Jun 15 14:43:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:08.814029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5447ed70-40a4-4e0f-92ca-78d500c38615 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bc3eb8b0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:08.969852 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:09.198752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5447ed70-40a4-4e0f-92ca-78d500c38615 tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.388518 Jun 15 14:43:09.200059 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 32/61] 10.222.0.45 () {58 vars in 1187 bytes} [Wed Jun 15 14:43:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:09.205096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-acd3c496-8be7-48a9-a7bf-0ba5ea3b3179 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:09.205949 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-acd3c496-8be7-48a9-a7bf-0ba5ea3b3179 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:09.242592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acd3c496-8be7-48a9-a7bf-0ba5ea3b3179 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:09.248602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acd3c496-8be7-48a9-a7bf-0ba5ea3b3179 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:09.251291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acd3c496-8be7-48a9-a7bf-0ba5ea3b3179 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:09.251759 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acd3c496-8be7-48a9-a7bf-0ba5ea3b3179 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:09.543989 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-acd3c496-8be7-48a9-a7bf-0ba5ea3b3179 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:09.545816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=14 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:09.561926 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-acd3c496-8be7-48a9-a7bf-0ba5ea3b3179 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1273 microversion: 2.1 time: 0.360332 Jun 15 14:43:09.565179 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 33/62] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:09 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1273 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:09.589057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-be6e2cc9-7dbb-4fca-9533-654cc43d91ef tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] Calling method '.version_select at 0x7f05bc399280>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:09.946073 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-be6e2cc9-7dbb-4fca-9533-654cc43d91ef tempest-VolumesTestJSON-472289027 tempest-VolumesTestJSON-472289027-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.373293 Jun 15 14:43:09.959057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 34/63] 10.222.0.45 () {58 vars in 1154 bytes} [Wed Jun 15 14:43:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:09.972288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-16d475bb-b4ae-42ea-a23f-66e6e1af244a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:09.976108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-16d475bb-b4ae-42ea-a23f-66e6e1af244a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:10.016501 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-16d475bb-b4ae-42ea-a23f-66e6e1af244a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:10.025097 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-16d475bb-b4ae-42ea-a23f-66e6e1af244a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:10.027250 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-16d475bb-b4ae-42ea-a23f-66e6e1af244a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:10.030569 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-16d475bb-b4ae-42ea-a23f-66e6e1af244a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:11.330071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:11.777136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-16d475bb-b4ae-42ea-a23f-66e6e1af244a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:11.807972 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-16d475bb-b4ae-42ea-a23f-66e6e1af244a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 1.858770 Jun 15 14:43:11.817470 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 35/64] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:09 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:11.859438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2d302fb8-6a1d-400d-ac85-10f7d318a896 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:11.860795 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2d302fb8-6a1d-400d-ac85-10f7d318a896 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:11.881065 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d302fb8-6a1d-400d-ac85-10f7d318a896 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:11.881863 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d302fb8-6a1d-400d-ac85-10f7d318a896 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:11.897442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d302fb8-6a1d-400d-ac85-10f7d318a896 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:11.901438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d302fb8-6a1d-400d-ac85-10f7d318a896 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:12.012275 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=20 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:13.134653 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2d302fb8-6a1d-400d-ac85-10f7d318a896 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:13.188312 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2d302fb8-6a1d-400d-ac85-10f7d318a896 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 1.366809 Jun 15 14:43:13.194229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 36/65] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:11 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:13.202914 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5575f22d-9719-4b0a-b852-d74eacf92892 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:13.207441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5575f22d-9719-4b0a-b852-d74eacf92892 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:13.240593 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5575f22d-9719-4b0a-b852-d74eacf92892 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:13.242183 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5575f22d-9719-4b0a-b852-d74eacf92892 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:13.245775 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5575f22d-9719-4b0a-b852-d74eacf92892 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:13.247637 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5575f22d-9719-4b0a-b852-d74eacf92892 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:14.249869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:43:14.251609 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:43:14.252631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:43:14.253563 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:43:14.254448 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:43:14.279816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:14.308184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:14.314515 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:14.315619 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:14.316157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:14.437643 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Getting quotas for project 6d3ce7cecd2f4983b8442f70ed2afdb1. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:14.470763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Getting quotas for user 1efb0951ba1144d58698e02e0e5e9416 and project 6d3ce7cecd2f4983b8442f70ed2afdb1. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:14.533212 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5575f22d-9719-4b0a-b852-d74eacf92892 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:14.541135 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=63 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:14.558151 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5575f22d-9719-4b0a-b852-d74eacf92892 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 1.360952 Jun 15 14:43:14.578247 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 37/66] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:13 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:14.578247 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-756808206", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd9528e4-f2a6-40a3-805a-4917720b5f35"}], "security_groups": [{"name": "tempest-securitygroup--1216651671"}], "key_name": "tempest-keypair-655202180", "user_data": "}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:14.581195 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:43:14.601170 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:43:14.643811 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:14.769065 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-db6a9af5-5b1a-40f3-be6a-a4668368cf8f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.680925 Jun 15 14:43:14.770331 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 30/67] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:43:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 8694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:43:14.786419 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-af16fcf9-cdff-45bc-83ad-ce81efd934b3 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:14.790636 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-af16fcf9-cdff-45bc-83ad-ce81efd934b3 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:14.806642 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-af16fcf9-cdff-45bc-83ad-ce81efd934b3 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:14.809319 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-af16fcf9-cdff-45bc-83ad-ce81efd934b3 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:14.814859 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-af16fcf9-cdff-45bc-83ad-ce81efd934b3 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:14.820105 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-af16fcf9-cdff-45bc-83ad-ce81efd934b3 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:15.674907 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-af16fcf9-cdff-45bc-83ad-ce81efd934b3 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:15.695717 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-af16fcf9-cdff-45bc-83ad-ce81efd934b3 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.917166 Jun 15 14:43:15.735187 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 31/68] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:14 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:15.744993 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a1ca6049-430f-4866-acec-6d470a8852c2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:15.765774 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a1ca6049-430f-4866-acec-6d470a8852c2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:15.837621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] validate_networks() for [('cd9528e4-f2a6-40a3-805a-4917720b5f35', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:43:16.158748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a1ca6049-430f-4866-acec-6d470a8852c2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:16.189836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a1ca6049-430f-4866-acec-6d470a8852c2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1236 microversion: 2.1 time: 0.452352 Jun 15 14:43:16.194304 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 32/69] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:15 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1236 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:16.215820 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2bb04a7f-d82e-4c54-873e-f4710451f490 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:16.236059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2bb04a7f-d82e-4c54-873e-f4710451f490 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:16.261687 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2bb04a7f-d82e-4c54-873e-f4710451f490 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:16.262469 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2bb04a7f-d82e-4c54-873e-f4710451f490 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:16.265685 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2bb04a7f-d82e-4c54-873e-f4710451f490 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:16.269838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2bb04a7f-d82e-4c54-873e-f4710451f490 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:17.760961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2bb04a7f-d82e-4c54-873e-f4710451f490 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:17.783284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2bb04a7f-d82e-4c54-873e-f4710451f490 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 1.580752 Jun 15 14:43:17.801068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 33/70] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:16 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:18.523935 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-9dda0d2d-82e1-4d30-8747-ac9dee3bd3fd req-4f09d769-1cd7-4ff7-a22b-5a93767c6535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66", "tag": "0a0e535f-062d-49cb-ba26-271db8cdd8d9"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:18.563569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-9dda0d2d-82e1-4d30-8747-ac9dee3bd3fd req-4f09d769-1cd7-4ff7-a22b-5a93767c6535 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:18.567574 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-9dda0d2d-82e1-4d30-8747-ac9dee3bd3fd req-4f09d769-1cd7-4ff7-a22b-5a93767c6535 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:18.625847 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-9dda0d2d-82e1-4d30-8747-ac9dee3bd3fd req-4f09d769-1cd7-4ff7-a22b-5a93767c6535 service nova] Creating event network-changed:0a0e535f-062d-49cb-ba26-271db8cdd8d9 for instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 on hv-cinder-80382 Jun 15 14:43:18.632141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-9dda0d2d-82e1-4d30-8747-ac9dee3bd3fd req-4f09d769-1cd7-4ff7-a22b-5a93767c6535 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 14:43:18.633883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9383ee8e-97b7-474f-8f6b-30f780cdd91c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:18.634489 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9383ee8e-97b7-474f-8f6b-30f780cdd91c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:18.635543 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9383ee8e-97b7-474f-8f6b-30f780cdd91c None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:18.639930 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9383ee8e-97b7-474f-8f6b-30f780cdd91c None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:18.664154 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.compute.rpcapi [None req-9383ee8e-97b7-474f-8f6b-30f780cdd91c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 14:43:18.665711 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9383ee8e-97b7-474f-8f6b-30f780cdd91c None None] Releasing lock "compute-rpcapi-router" {{(pid=124178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 14:43:18.718619 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9383ee8e-97b7-474f-8f6b-30f780cdd91c None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.912821 Jun 15 14:43:18.719817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 34/71] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:18.727444 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-18e14c90-df6a-49dd-a019-4b5dc7c8f5e2 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:18.728165 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-18e14c90-df6a-49dd-a019-4b5dc7c8f5e2 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:18.747037 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18e14c90-df6a-49dd-a019-4b5dc7c8f5e2 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:18.747507 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18e14c90-df6a-49dd-a019-4b5dc7c8f5e2 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:18.749948 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18e14c90-df6a-49dd-a019-4b5dc7c8f5e2 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:18.750678 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18e14c90-df6a-49dd-a019-4b5dc7c8f5e2 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:19.268110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-18e14c90-df6a-49dd-a019-4b5dc7c8f5e2 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:19.291672 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-18e14c90-df6a-49dd-a019-4b5dc7c8f5e2 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.569621 Jun 15 14:43:19.295981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 35/72] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:18 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:19.315440 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8e8a84fe-d598-47ab-a034-809d4f3876dd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:19.322409 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8e8a84fe-d598-47ab-a034-809d4f3876dd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:19.346599 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e8a84fe-d598-47ab-a034-809d4f3876dd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:19.347597 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e8a84fe-d598-47ab-a034-809d4f3876dd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:19.349134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e8a84fe-d598-47ab-a034-809d4f3876dd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:19.350052 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e8a84fe-d598-47ab-a034-809d4f3876dd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:19.353807 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:43:19.354359 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:43:19.354696 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:43:19.355434 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:43:19.356003 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:43:19.400883 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:19.406277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:19.407884 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:19.408669 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:19.485125 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Getting quotas for project 54d57ba7dd0d441b9748fc600bc34972. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:19.501524 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Getting quotas for user 25ba370b8daf49e48514cd49c2851215 and project 54d57ba7dd0d441b9748fc600bc34972. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:19.532746 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:43:19.546979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:43:19.628866 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7396d8d4-d466-4ce2-8cce-8b702b758a57 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.065080 Jun 15 14:43:19.634683 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 38/73] 10.222.0.45 () {62 vars in 1187 bytes} [Wed Jun 15 14:43:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 5068 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 14:43:19.717566 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8e8a84fe-d598-47ab-a034-809d4f3876dd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:19.733303 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8e8a84fe-d598-47ab-a034-809d4f3876dd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1294 microversion: 2.1 time: 0.435948 Jun 15 14:43:19.733845 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 36/74] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:19 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1294 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:19.749303 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cbbdf55b-aea1-426e-a60d-c4f109bd1331 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:19.750267 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cbbdf55b-aea1-426e-a60d-c4f109bd1331 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:19.758055 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cbbdf55b-aea1-426e-a60d-c4f109bd1331 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:19.758902 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cbbdf55b-aea1-426e-a60d-c4f109bd1331 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:19.759971 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cbbdf55b-aea1-426e-a60d-c4f109bd1331 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:19.760639 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cbbdf55b-aea1-426e-a60d-c4f109bd1331 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:20.000129 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-c6cf3b5a-8619-4b2b-8cfe-24d3b27d06ad req-770c795c-bfd9-487f-ad36-57976b5a6f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6db7511-cad4-4d72-8939-8dd1483150d1", "tag": "3fed3571-ad3e-487a-9939-29301e865daa"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:20.060160 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-c6cf3b5a-8619-4b2b-8cfe-24d3b27d06ad req-770c795c-bfd9-487f-ad36-57976b5a6f1a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:20.060837 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-c6cf3b5a-8619-4b2b-8cfe-24d3b27d06ad req-770c795c-bfd9-487f-ad36-57976b5a6f1a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:20.068778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cbbdf55b-aea1-426e-a60d-c4f109bd1331 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:20.077834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cbbdf55b-aea1-426e-a60d-c4f109bd1331 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.332377 Jun 15 14:43:20.078935 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 37/75] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:19 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:20.086263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-bc187ff5-bc38-4425-8681-e4d7164cdb66 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:20.087427 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bc187ff5-bc38-4425-8681-e4d7164cdb66 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:20.103820 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-c6cf3b5a-8619-4b2b-8cfe-24d3b27d06ad req-770c795c-bfd9-487f-ad36-57976b5a6f1a service nova] Creating event network-changed:3fed3571-ad3e-487a-9939-29301e865daa for instance d6db7511-cad4-4d72-8939-8dd1483150d1 on hv-cinder-80382 Jun 15 14:43:20.104472 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-c6cf3b5a-8619-4b2b-8cfe-24d3b27d06ad req-770c795c-bfd9-487f-ad36-57976b5a6f1a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124179) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 14:43:20.105851 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b21682a2-9816-43a9-87f9-767633f1c8c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:20.106424 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b21682a2-9816-43a9-87f9-767633f1c8c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:20.107270 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b21682a2-9816-43a9-87f9-767633f1c8c6 None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:20.108369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b21682a2-9816-43a9-87f9-767633f1c8c6 None None] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:20.121123 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.compute.rpcapi [None req-b21682a2-9816-43a9-87f9-767633f1c8c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 14:43:20.122094 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b21682a2-9816-43a9-87f9-767633f1c8c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=124179) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 14:43:20.144838 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b21682a2-9816-43a9-87f9-767633f1c8c6 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.508525 Jun 15 14:43:20.151313 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 39/76] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:20.189876 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bc187ff5-bc38-4425-8681-e4d7164cdb66 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:20.209771 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bc187ff5-bc38-4425-8681-e4d7164cdb66 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:20.215789 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bc187ff5-bc38-4425-8681-e4d7164cdb66 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:20.218350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-bc187ff5-bc38-4425-8681-e4d7164cdb66 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1280 microversion: 2.20 time: 0.137793 Jun 15 14:43:20.236367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 38/77] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:20 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:20.327919 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4a8ba4c9-3bbe-4cb0-b332-eacaca9d40d9 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:20.328805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4a8ba4c9-3bbe-4cb0-b332-eacaca9d40d9 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:20.343240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a8ba4c9-3bbe-4cb0-b332-eacaca9d40d9 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:20.343792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a8ba4c9-3bbe-4cb0-b332-eacaca9d40d9 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:20.344922 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a8ba4c9-3bbe-4cb0-b332-eacaca9d40d9 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:20.346812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a8ba4c9-3bbe-4cb0-b332-eacaca9d40d9 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:20.625781 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4a8ba4c9-3bbe-4cb0-b332-eacaca9d40d9 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:20.638263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4a8ba4c9-3bbe-4cb0-b332-eacaca9d40d9 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.315269 Jun 15 14:43:20.639982 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 40/78] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:20 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:20.750478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a0c10339-ea1f-4f3a-bd2a-fbc07c66a010 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:20.752779 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a0c10339-ea1f-4f3a-bd2a-fbc07c66a010 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:20.763575 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0c10339-ea1f-4f3a-bd2a-fbc07c66a010 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:20.764644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0c10339-ea1f-4f3a-bd2a-fbc07c66a010 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:20.765982 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0c10339-ea1f-4f3a-bd2a-fbc07c66a010 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:20.766637 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0c10339-ea1f-4f3a-bd2a-fbc07c66a010 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:20.796126 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-95221247-0bdd-4383-98b2-a2309a2478ca req-e8f91a80-3fb5-45d1-a06a-04c18649da48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d16976b-b746-452b-b48d-b7a26950a19e", "tag": "24f578b6-7f09-4add-8d9b-74b34e954ebf"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:20.822819 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-95221247-0bdd-4383-98b2-a2309a2478ca req-e8f91a80-3fb5-45d1-a06a-04c18649da48 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:20.826574 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-95221247-0bdd-4383-98b2-a2309a2478ca req-e8f91a80-3fb5-45d1-a06a-04c18649da48 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:20.861634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-95221247-0bdd-4383-98b2-a2309a2478ca req-e8f91a80-3fb5-45d1-a06a-04c18649da48 service nova] Creating event network-changed:24f578b6-7f09-4add-8d9b-74b34e954ebf for instance 1d16976b-b746-452b-b48d-b7a26950a19e on hv-cinder-80382 Jun 15 14:43:20.874362 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-95221247-0bdd-4383-98b2-a2309a2478ca req-e8f91a80-3fb5-45d1-a06a-04c18649da48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081960 Jun 15 14:43:20.879374 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 41/79] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:20.912522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a0c10339-ea1f-4f3a-bd2a-fbc07c66a010 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:20.928609 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a0c10339-ea1f-4f3a-bd2a-fbc07c66a010 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1294 microversion: 2.1 time: 0.182578 Jun 15 14:43:20.929239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 39/80] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:20 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1294 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:21.098157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-46fa0b16-1aac-4c5f-9ef6-9649bc83dd23 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:21.098855 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-46fa0b16-1aac-4c5f-9ef6-9649bc83dd23 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:21.106044 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46fa0b16-1aac-4c5f-9ef6-9649bc83dd23 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.107124 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46fa0b16-1aac-4c5f-9ef6-9649bc83dd23 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:21.108189 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46fa0b16-1aac-4c5f-9ef6-9649bc83dd23 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.109127 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46fa0b16-1aac-4c5f-9ef6-9649bc83dd23 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:21.243971 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:21.244891 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:21.259577 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.260783 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:21.262817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.264342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:21.433890 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:21.441188 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-46fa0b16-1aac-4c5f-9ef6-9649bc83dd23 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:21.448783 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:21.451767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-46fa0b16-1aac-4c5f-9ef6-9649bc83dd23 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.357907 Jun 15 14:43:21.459073 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 42/81] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:21 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:21.459414 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:21.459414 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-afec17f0-6eff-475d-9e72-b7986a4d3ac9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1284 microversion: 2.20 time: 0.217517 Jun 15 14:43:21.468982 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 40/82] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:21 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:21.659710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b374963d-cf1d-48c1-a9f7-86b27c47f5b8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:21.660502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b374963d-cf1d-48c1-a9f7-86b27c47f5b8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:21.673127 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b374963d-cf1d-48c1-a9f7-86b27c47f5b8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.673682 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b374963d-cf1d-48c1-a9f7-86b27c47f5b8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:21.682153 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b374963d-cf1d-48c1-a9f7-86b27c47f5b8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.683881 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b374963d-cf1d-48c1-a9f7-86b27c47f5b8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:21.948102 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3168c443-53ab-4f46-980a-294ef7c31983 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:21.949819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3168c443-53ab-4f46-980a-294ef7c31983 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:21.968411 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3168c443-53ab-4f46-980a-294ef7c31983 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.969779 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3168c443-53ab-4f46-980a-294ef7c31983 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:21.970845 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3168c443-53ab-4f46-980a-294ef7c31983 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.971689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3168c443-53ab-4f46-980a-294ef7c31983 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:22.680181 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b374963d-cf1d-48c1-a9f7-86b27c47f5b8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:22.698701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b374963d-cf1d-48c1-a9f7-86b27c47f5b8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 1.042024 Jun 15 14:43:22.699361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 43/83] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:21 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:22.718133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e1b2d6ba-e9a4-44c0-919f-7923bca066ca tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:22.719237 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e1b2d6ba-e9a4-44c0-919f-7923bca066ca tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:22.719625 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3168c443-53ab-4f46-980a-294ef7c31983 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:22.732620 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1b2d6ba-e9a4-44c0-919f-7923bca066ca tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:22.733583 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1b2d6ba-e9a4-44c0-919f-7923bca066ca tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:22.735471 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1b2d6ba-e9a4-44c0-919f-7923bca066ca tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:22.736404 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1b2d6ba-e9a4-44c0-919f-7923bca066ca tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:22.738044 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3168c443-53ab-4f46-980a-294ef7c31983 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.789847 Jun 15 14:43:22.739102 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 41/84] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:21 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:22.755417 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:22.756321 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:22.774137 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:22.774898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:22.777350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:22.777799 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:23.055239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:23.092406 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:23.103674 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:23.119679 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9bee0d37-7fa2-4bef-9044-b0b600c97826 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.364187 Jun 15 14:43:23.127735 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 42/85] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:22 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:23.143756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-af8ae9f9-e640-460d-b54b-15de97a4db36 req-d2398f6b-155c-421d-a783-8ee670187d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "992c4ee6-083c-4194-adff-7bf50b93e91c", "tag": "949f1732-468d-4323-8ec1-88c3490ca899"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:23.155244 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-af8ae9f9-e640-460d-b54b-15de97a4db36 req-d2398f6b-155c-421d-a783-8ee670187d5a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:23.155925 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-af8ae9f9-e640-460d-b54b-15de97a4db36 req-d2398f6b-155c-421d-a783-8ee670187d5a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:23.160030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1b2d6ba-e9a4-44c0-919f-7923bca066ca tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:23.162639 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=99 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:23.171993 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e1b2d6ba-e9a4-44c0-919f-7923bca066ca tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.471316 Jun 15 14:43:23.173203 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-af8ae9f9-e640-460d-b54b-15de97a4db36 req-d2398f6b-155c-421d-a783-8ee670187d5a service nova] Creating event network-changed:949f1732-468d-4323-8ec1-88c3490ca899 for instance 992c4ee6-083c-4194-adff-7bf50b93e91c on hv-cinder-80382 Jun 15 14:43:23.179275 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-af8ae9f9-e640-460d-b54b-15de97a4db36 req-d2398f6b-155c-421d-a783-8ee670187d5a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049913 Jun 15 14:43:23.180147 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 43/86] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:23.182412 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 44/87] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:22 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:23.718409 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-95264261-9ee3-4726-bb2e-147cc51e83ff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:23.718698 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-95264261-9ee3-4726-bb2e-147cc51e83ff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:23.731912 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-95264261-9ee3-4726-bb2e-147cc51e83ff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:23.732375 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-95264261-9ee3-4726-bb2e-147cc51e83ff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:23.733150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-95264261-9ee3-4726-bb2e-147cc51e83ff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:23.733582 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-95264261-9ee3-4726-bb2e-147cc51e83ff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:23.760441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-83472814-bbf0-4d03-aef1-a97f091eddc7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:23.761133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-83472814-bbf0-4d03-aef1-a97f091eddc7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:23.771563 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83472814-bbf0-4d03-aef1-a97f091eddc7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:23.774437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83472814-bbf0-4d03-aef1-a97f091eddc7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:23.775336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83472814-bbf0-4d03-aef1-a97f091eddc7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:23.778107 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83472814-bbf0-4d03-aef1-a97f091eddc7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:24.093428 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-83472814-bbf0-4d03-aef1-a97f091eddc7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:24.097448 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-95264261-9ee3-4726-bb2e-147cc51e83ff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:24.102934 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-83472814-bbf0-4d03-aef1-a97f091eddc7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.347728 Jun 15 14:43:24.103871 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 45/88] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:23 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:24.107658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-95264261-9ee3-4726-bb2e-147cc51e83ff tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.394491 Jun 15 14:43:24.108656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 44/89] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:23 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:24.155074 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:24.155991 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:24.163631 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:24.164221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:24.165250 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:24.165755 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:24.189842 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f95b2424-9321-489c-8da9-00e3515b1428 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:24.190852 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f95b2424-9321-489c-8da9-00e3515b1428 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:24.198332 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f95b2424-9321-489c-8da9-00e3515b1428 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:24.199190 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f95b2424-9321-489c-8da9-00e3515b1428 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:24.200278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f95b2424-9321-489c-8da9-00e3515b1428 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:24.201032 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f95b2424-9321-489c-8da9-00e3515b1428 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:24.262139 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:24.271803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:24.273758 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:24.275500 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a4b0eb50-6e8e-4a78-b3b5-5699a909112a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.124945 Jun 15 14:43:24.276891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 46/90] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:24 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:24.393512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f95b2424-9321-489c-8da9-00e3515b1428 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:24.404995 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f95b2424-9321-489c-8da9-00e3515b1428 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.218929 Jun 15 14:43:24.406048 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 45/91] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:24 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:25.127332 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ba3a7bc2-2b08-4dd3-a89d-92c68dd48b62 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:25.128344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ba3a7bc2-2b08-4dd3-a89d-92c68dd48b62 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:25.133185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-db51fade-8281-435f-957e-32d72f732703 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:25.134169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-db51fade-8281-435f-957e-32d72f732703 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:25.138959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ba3a7bc2-2b08-4dd3-a89d-92c68dd48b62 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.139724 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ba3a7bc2-2b08-4dd3-a89d-92c68dd48b62 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.140977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ba3a7bc2-2b08-4dd3-a89d-92c68dd48b62 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.141741 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ba3a7bc2-2b08-4dd3-a89d-92c68dd48b62 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.144334 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db51fade-8281-435f-957e-32d72f732703 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.145076 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db51fade-8281-435f-957e-32d72f732703 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.146322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db51fade-8281-435f-957e-32d72f732703 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.147064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db51fade-8281-435f-957e-32d72f732703 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.341302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-db51fade-8281-435f-957e-32d72f732703 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:25.357392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-db51fade-8281-435f-957e-32d72f732703 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.231351 Jun 15 14:43:25.358305 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 46/92] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:25 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:25.375414 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:25.376517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:25.386207 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.386759 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.388581 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.389046 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.410624 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ba3a7bc2-2b08-4dd3-a89d-92c68dd48b62 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:25.422912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ba3a7bc2-2b08-4dd3-a89d-92c68dd48b62 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.300647 Jun 15 14:43:25.436675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 47/93] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:25 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:25.441923 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e1f8493a-5ec8-4f03-ac03-c153abd22469 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:25.442554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e1f8493a-5ec8-4f03-ac03-c153abd22469 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:25.449314 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1f8493a-5ec8-4f03-ac03-c153abd22469 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.449954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1f8493a-5ec8-4f03-ac03-c153abd22469 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.450756 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1f8493a-5ec8-4f03-ac03-c153abd22469 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.451255 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1f8493a-5ec8-4f03-ac03-c153abd22469 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.507840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:25.516272 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:25.517806 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:25.518946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-72cbc8fa-5998-4c70-bc22-4ebd4a35da3f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.159364 Jun 15 14:43:25.519867 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 47/94] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:25 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:25.661365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1f8493a-5ec8-4f03-ac03-c153abd22469 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:25.669820 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e1f8493a-5ec8-4f03-ac03-c153abd22469 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.231959 Jun 15 14:43:25.670411 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 48/95] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:25 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:26.375666 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f1223760-47cb-41a8-95e1-0c927bb1d084 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:26.376411 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f1223760-47cb-41a8-95e1-0c927bb1d084 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:26.386457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f1223760-47cb-41a8-95e1-0c927bb1d084 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.386457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f1223760-47cb-41a8-95e1-0c927bb1d084 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.387273 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f1223760-47cb-41a8-95e1-0c927bb1d084 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.387754 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f1223760-47cb-41a8-95e1-0c927bb1d084 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.441426 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9788c126-5e32-4805-b2f7-72329fa9e7f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:26.442059 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9788c126-5e32-4805-b2f7-72329fa9e7f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:26.449140 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9788c126-5e32-4805-b2f7-72329fa9e7f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.449589 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9788c126-5e32-4805-b2f7-72329fa9e7f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.450358 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9788c126-5e32-4805-b2f7-72329fa9e7f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.450791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9788c126-5e32-4805-b2f7-72329fa9e7f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.626899 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f1223760-47cb-41a8-95e1-0c927bb1d084 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:26.638258 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f1223760-47cb-41a8-95e1-0c927bb1d084 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.266473 Jun 15 14:43:26.638962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 48/96] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:26 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:26.652894 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:26.656075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9788c126-5e32-4805-b2f7-72329fa9e7f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:26.659844 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:26.666777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9788c126-5e32-4805-b2f7-72329fa9e7f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.229676 Jun 15 14:43:26.668227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 49/97] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:26 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:26.668665 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.669124 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.678110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.678894 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.693091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5a2fa8ce-0de9-4847-a99b-511f1fc6699c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:26.694319 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5a2fa8ce-0de9-4847-a99b-511f1fc6699c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:26.702759 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a2fa8ce-0de9-4847-a99b-511f1fc6699c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.703316 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a2fa8ce-0de9-4847-a99b-511f1fc6699c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.704195 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a2fa8ce-0de9-4847-a99b-511f1fc6699c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.704692 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a2fa8ce-0de9-4847-a99b-511f1fc6699c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.766964 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:26.777736 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:26.779273 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:26.780731 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-690d387e-d721-4ee5-a6a5-4ff9dd7d0093 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.131596 Jun 15 14:43:26.781113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 49/98] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:26 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:26.870336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5a2fa8ce-0de9-4847-a99b-511f1fc6699c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:26.879221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5a2fa8ce-0de9-4847-a99b-511f1fc6699c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.189897 Jun 15 14:43:26.889683 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 50/99] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:26 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:27.656189 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9df9fd3a-f7fd-4adf-bb5f-2d4c937fbd87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:27.656901 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9df9fd3a-f7fd-4adf-bb5f-2d4c937fbd87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:27.663778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9df9fd3a-f7fd-4adf-bb5f-2d4c937fbd87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.664228 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9df9fd3a-f7fd-4adf-bb5f-2d4c937fbd87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:27.664998 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9df9fd3a-f7fd-4adf-bb5f-2d4c937fbd87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.665433 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9df9fd3a-f7fd-4adf-bb5f-2d4c937fbd87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:27.686141 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-479d7289-8fa8-4d74-a17f-380c3643b54a tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:27.687230 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-479d7289-8fa8-4d74-a17f-380c3643b54a tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:27.695861 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-479d7289-8fa8-4d74-a17f-380c3643b54a tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.696234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-479d7289-8fa8-4d74-a17f-380c3643b54a tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:27.697189 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-479d7289-8fa8-4d74-a17f-380c3643b54a tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.697623 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-479d7289-8fa8-4d74-a17f-380c3643b54a tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:27.890395 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9df9fd3a-f7fd-4adf-bb5f-2d4c937fbd87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:27.899701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9df9fd3a-f7fd-4adf-bb5f-2d4c937fbd87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.247701 Jun 15 14:43:27.900549 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 50/100] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:27 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:27.907706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:27.908589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:27.917025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.917566 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:27.918529 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.919171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:27.931657 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-479d7289-8fa8-4d74-a17f-380c3643b54a tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:27.947885 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-479d7289-8fa8-4d74-a17f-380c3643b54a tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.265591 Jun 15 14:43:27.948390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 51/101] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:27 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:27.953141 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-067c86f2-ae0a-41cd-bf0d-687fee93836f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:27.954087 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-067c86f2-ae0a-41cd-bf0d-687fee93836f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:27.969997 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-067c86f2-ae0a-41cd-bf0d-687fee93836f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.970469 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-067c86f2-ae0a-41cd-bf0d-687fee93836f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:27.971285 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-067c86f2-ae0a-41cd-bf0d-687fee93836f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.972080 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-067c86f2-ae0a-41cd-bf0d-687fee93836f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:28.009643 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:28.019627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:28.022059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:28.023353 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-339cda7f-b6cd-4865-8904-25374c6d9344 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.120877 Jun 15 14:43:28.024662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 51/102] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:27 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:28.151653 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-067c86f2-ae0a-41cd-bf0d-687fee93836f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:28.162486 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-067c86f2-ae0a-41cd-bf0d-687fee93836f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.212833 Jun 15 14:43:28.164196 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 52/103] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:27 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:28.920465 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-699d9674-d715-4c6f-a8b0-7b431412ec25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:28.921141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-699d9674-d715-4c6f-a8b0-7b431412ec25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:28.923381 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=4 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:28.932512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-699d9674-d715-4c6f-a8b0-7b431412ec25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:28.932968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-699d9674-d715-4c6f-a8b0-7b431412ec25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:28.933963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-699d9674-d715-4c6f-a8b0-7b431412ec25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:28.934407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-699d9674-d715-4c6f-a8b0-7b431412ec25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:28.966673 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f5e760ba-80c7-4277-a9ef-ba1e6e57eb4f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:28.967481 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f5e760ba-80c7-4277-a9ef-ba1e6e57eb4f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:28.992064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f5e760ba-80c7-4277-a9ef-ba1e6e57eb4f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:28.992524 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f5e760ba-80c7-4277-a9ef-ba1e6e57eb4f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:28.993390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f5e760ba-80c7-4277-a9ef-ba1e6e57eb4f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:28.993823 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f5e760ba-80c7-4277-a9ef-ba1e6e57eb4f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:29.216689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-699d9674-d715-4c6f-a8b0-7b431412ec25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.226258 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-699d9674-d715-4c6f-a8b0-7b431412ec25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.310160 Jun 15 14:43:29.227350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 52/104] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:28 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:29.232617 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:29.233636 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:29.241171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:29.241818 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:29.242856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:29.243808 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:29.272263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f5e760ba-80c7-4277-a9ef-ba1e6e57eb4f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.281948 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f5e760ba-80c7-4277-a9ef-ba1e6e57eb4f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.319890 Jun 15 14:43:29.292818 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 53/105] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:28 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:29.297758 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e85788a0-a62a-4fec-b696-4767441df4f4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:29.298438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e85788a0-a62a-4fec-b696-4767441df4f4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:29.306749 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e85788a0-a62a-4fec-b696-4767441df4f4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:29.307229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e85788a0-a62a-4fec-b696-4767441df4f4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:29.308015 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e85788a0-a62a-4fec-b696-4767441df4f4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:29.308449 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e85788a0-a62a-4fec-b696-4767441df4f4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:29.329411 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.356639 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.361675 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.365898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-656d0c16-f847-404b-b706-763991444fca tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.135407 Jun 15 14:43:29.371793 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 53/106] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:29 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:29.502542 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e85788a0-a62a-4fec-b696-4767441df4f4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.511478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e85788a0-a62a-4fec-b696-4767441df4f4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.217471 Jun 15 14:43:29.527399 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 54/107] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:29 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:30.245833 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-992d565f-1132-479f-92c9-a56dc3cd289f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:30.247453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-992d565f-1132-479f-92c9-a56dc3cd289f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:30.249425 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=10 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:30.267283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-992d565f-1132-479f-92c9-a56dc3cd289f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.270314 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-992d565f-1132-479f-92c9-a56dc3cd289f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.273302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-992d565f-1132-479f-92c9-a56dc3cd289f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.274222 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-992d565f-1132-479f-92c9-a56dc3cd289f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.304062 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8c96c7b0-d361-4aef-95cb-506552e11a2d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:30.305414 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8c96c7b0-d361-4aef-95cb-506552e11a2d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:30.314088 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:30.315872 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:30.318509 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8c96c7b0-d361-4aef-95cb-506552e11a2d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.319101 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8c96c7b0-d361-4aef-95cb-506552e11a2d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.320971 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8c96c7b0-d361-4aef-95cb-506552e11a2d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.321839 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8c96c7b0-d361-4aef-95cb-506552e11a2d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.511911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-992d565f-1132-479f-92c9-a56dc3cd289f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:30.522709 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-992d565f-1132-479f-92c9-a56dc3cd289f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.281994 Jun 15 14:43:30.534512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 54/108] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:30 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:30.541998 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:30.542617 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:30.555885 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8c96c7b0-d361-4aef-95cb-506552e11a2d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:30.560026 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.560650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.563877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.564398 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.567528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8c96c7b0-d361-4aef-95cb-506552e11a2d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.271048 Jun 15 14:43:30.568660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 55/109] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:30 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:30.579977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2a08ff2a-6750-4fb2-8470-da2828b62f3a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:30.584784 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2a08ff2a-6750-4fb2-8470-da2828b62f3a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:30.599195 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a08ff2a-6750-4fb2-8470-da2828b62f3a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.599719 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a08ff2a-6750-4fb2-8470-da2828b62f3a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.603225 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a08ff2a-6750-4fb2-8470-da2828b62f3a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.603730 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a08ff2a-6750-4fb2-8470-da2828b62f3a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.613992 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:30.679713 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:30.693969 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:30.696045 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:30.697559 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3c7f9317-e617-46dd-9944-54dfd15e899b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.161438 Jun 15 14:43:30.698145 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 55/110] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:30 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:31.031900 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2a08ff2a-6750-4fb2-8470-da2828b62f3a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:31.043767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2a08ff2a-6750-4fb2-8470-da2828b62f3a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.468858 Jun 15 14:43:31.053882 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 56/111] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:30 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:31.542564 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2a96a374-b530-4a03-8b52-b05d9eb039a1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:31.543211 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2a96a374-b530-4a03-8b52-b05d9eb039a1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:31.550213 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2a96a374-b530-4a03-8b52-b05d9eb039a1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:31.550944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2a96a374-b530-4a03-8b52-b05d9eb039a1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:31.551773 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2a96a374-b530-4a03-8b52-b05d9eb039a1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:31.552242 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2a96a374-b530-4a03-8b52-b05d9eb039a1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:31.589916 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-72e8685b-26b4-43eb-9f77-313400ea0cee tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:31.590450 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-72e8685b-26b4-43eb-9f77-313400ea0cee tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:31.600423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72e8685b-26b4-43eb-9f77-313400ea0cee tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:31.601151 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72e8685b-26b4-43eb-9f77-313400ea0cee tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:31.602146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72e8685b-26b4-43eb-9f77-313400ea0cee tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:31.603057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72e8685b-26b4-43eb-9f77-313400ea0cee tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:31.826510 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2a96a374-b530-4a03-8b52-b05d9eb039a1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:31.836965 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2a96a374-b530-4a03-8b52-b05d9eb039a1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.298537 Jun 15 14:43:31.848256 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 56/112] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:31 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:31.854017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:31.854923 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:31.862443 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:31.863772 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:31.864813 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:31.865698 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:31.872514 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-72e8685b-26b4-43eb-9f77-313400ea0cee tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:31.884029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-72e8685b-26b4-43eb-9f77-313400ea0cee tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.300267 Jun 15 14:43:31.885089 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 57/113] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:31 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:31.944731 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:31.956143 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:31.971529 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:31.973462 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fd90cf8c-2947-4d50-80be-f53918c50f59 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.122940 Jun 15 14:43:31.976068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 57/114] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:31 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:32.063275 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1b01f3fc-d74f-4927-8f72-df47ecb78f6a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:32.064612 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1b01f3fc-d74f-4927-8f72-df47ecb78f6a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:32.074965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b01f3fc-d74f-4927-8f72-df47ecb78f6a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.075852 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b01f3fc-d74f-4927-8f72-df47ecb78f6a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:32.076830 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b01f3fc-d74f-4927-8f72-df47ecb78f6a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.078212 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b01f3fc-d74f-4927-8f72-df47ecb78f6a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:32.240627 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1b01f3fc-d74f-4927-8f72-df47ecb78f6a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:32.251158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1b01f3fc-d74f-4927-8f72-df47ecb78f6a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.194443 Jun 15 14:43:32.251992 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 58/115] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:32 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:32.859835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-be572bf1-bc7d-420c-aad7-07032cc5b693 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:32.861627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-be572bf1-bc7d-420c-aad7-07032cc5b693 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:32.871372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-be572bf1-bc7d-420c-aad7-07032cc5b693 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.872578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-be572bf1-bc7d-420c-aad7-07032cc5b693 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:32.873723 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-be572bf1-bc7d-420c-aad7-07032cc5b693 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.874512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-be572bf1-bc7d-420c-aad7-07032cc5b693 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:32.904002 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-440aa792-3f40-45bc-9fbe-44fcdf3232ec tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:32.905141 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-440aa792-3f40-45bc-9fbe-44fcdf3232ec tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:32.913309 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-440aa792-3f40-45bc-9fbe-44fcdf3232ec tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.913940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-440aa792-3f40-45bc-9fbe-44fcdf3232ec tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:32.914907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-440aa792-3f40-45bc-9fbe-44fcdf3232ec tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.915888 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-440aa792-3f40-45bc-9fbe-44fcdf3232ec tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.160982 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-440aa792-3f40-45bc-9fbe-44fcdf3232ec tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.178041 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-440aa792-3f40-45bc-9fbe-44fcdf3232ec tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.275751 Jun 15 14:43:33.188151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-be572bf1-bc7d-420c-aad7-07032cc5b693 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.191234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 59/116] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:32 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:33.197460 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-be572bf1-bc7d-420c-aad7-07032cc5b693 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.344767 Jun 15 14:43:33.198140 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 58/117] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:32 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:33.200578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:33.201184 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:33.209746 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:33.210469 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.211444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:33.211961 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.268584 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8d8ff9ac-2ede-499f-bdf2-84f1adc6c7f1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:33.269418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8d8ff9ac-2ede-499f-bdf2-84f1adc6c7f1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:33.277604 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8d8ff9ac-2ede-499f-bdf2-84f1adc6c7f1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:33.277940 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8d8ff9ac-2ede-499f-bdf2-84f1adc6c7f1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.278896 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8d8ff9ac-2ede-499f-bdf2-84f1adc6c7f1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:33.279361 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8d8ff9ac-2ede-499f-bdf2-84f1adc6c7f1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.311559 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.320256 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.322045 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.323195 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-47246721-00b6-4c5f-b3ed-8816529664a8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.126514 Jun 15 14:43:33.324219 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 60/118] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:33 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:33.467170 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8d8ff9ac-2ede-499f-bdf2-84f1adc6c7f1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.477523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8d8ff9ac-2ede-499f-bdf2-84f1adc6c7f1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.212954 Jun 15 14:43:33.491086 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 59/119] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:33 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:34.198611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9e6993d7-3e00-4f81-95ab-5333162da932 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:34.199320 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9e6993d7-3e00-4f81-95ab-5333162da932 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:34.205901 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e6993d7-3e00-4f81-95ab-5333162da932 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.206869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e6993d7-3e00-4f81-95ab-5333162da932 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.213710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e6993d7-3e00-4f81-95ab-5333162da932 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.213710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e6993d7-3e00-4f81-95ab-5333162da932 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.217404 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a719169e-de24-450f-a046-46ed6920da6d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:34.218128 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a719169e-de24-450f-a046-46ed6920da6d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:34.228834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a719169e-de24-450f-a046-46ed6920da6d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.230249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a719169e-de24-450f-a046-46ed6920da6d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.232375 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a719169e-de24-450f-a046-46ed6920da6d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.233677 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a719169e-de24-450f-a046-46ed6920da6d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.259614 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=100 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:34.461729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9e6993d7-3e00-4f81-95ab-5333162da932 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:34.463127 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a719169e-de24-450f-a046-46ed6920da6d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:34.471492 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9e6993d7-3e00-4f81-95ab-5333162da932 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.276529 Jun 15 14:43:34.472091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 61/120] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:34 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:34.472765 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a719169e-de24-450f-a046-46ed6920da6d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.260478 Jun 15 14:43:34.483587 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 60/121] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:34 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:34.488257 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:34.489311 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:34.497178 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.498329 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.499428 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.500177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.510397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0f62926a-ba80-4f23-a6b4-f4b82a1aa160 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:34.511106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0f62926a-ba80-4f23-a6b4-f4b82a1aa160 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:34.519464 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f62926a-ba80-4f23-a6b4-f4b82a1aa160 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.519923 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f62926a-ba80-4f23-a6b4-f4b82a1aa160 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.520819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f62926a-ba80-4f23-a6b4-f4b82a1aa160 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.521962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f62926a-ba80-4f23-a6b4-f4b82a1aa160 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.580067 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:34.600352 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:34.602509 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:34.603955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-82d9ee6f-12a6-4680-8ed7-3dead9cce558 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.120278 Jun 15 14:43:34.604703 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 62/122] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:34 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:34.699927 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0f62926a-ba80-4f23-a6b4-f4b82a1aa160 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:34.711866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0f62926a-ba80-4f23-a6b4-f4b82a1aa160 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.212278 Jun 15 14:43:34.712710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 61/123] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:34 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:35.490365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a595957b-6da6-47bb-999d-9b2b62da1aac tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:35.491607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a595957b-6da6-47bb-999d-9b2b62da1aac tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:35.491789 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f5692706-2f97-4490-8274-dbef41200c93 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:35.492881 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f5692706-2f97-4490-8274-dbef41200c93 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:35.498108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a595957b-6da6-47bb-999d-9b2b62da1aac tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.498571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a595957b-6da6-47bb-999d-9b2b62da1aac tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.499531 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a595957b-6da6-47bb-999d-9b2b62da1aac tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.499973 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a595957b-6da6-47bb-999d-9b2b62da1aac tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.500093 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5692706-2f97-4490-8274-dbef41200c93 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.500554 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5692706-2f97-4490-8274-dbef41200c93 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.501319 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5692706-2f97-4490-8274-dbef41200c93 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.501753 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5692706-2f97-4490-8274-dbef41200c93 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.716803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f5692706-2f97-4490-8274-dbef41200c93 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.720464 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a595957b-6da6-47bb-999d-9b2b62da1aac tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.735098 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a595957b-6da6-47bb-999d-9b2b62da1aac tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.248483 Jun 15 14:43:35.735860 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 63/124] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:35 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:35.736563 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f5692706-2f97-4490-8274-dbef41200c93 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.249739 Jun 15 14:43:35.737227 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 62/125] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:35 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:35.746115 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d0ae0d93-9cf1-4e3f-8b78-6dccfa2f3c30 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:35.746792 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d0ae0d93-9cf1-4e3f-8b78-6dccfa2f3c30 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:35.754696 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0ae0d93-9cf1-4e3f-8b78-6dccfa2f3c30 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.755805 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0ae0d93-9cf1-4e3f-8b78-6dccfa2f3c30 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.756816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0ae0d93-9cf1-4e3f-8b78-6dccfa2f3c30 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.757407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0ae0d93-9cf1-4e3f-8b78-6dccfa2f3c30 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.758102 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:35.758716 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:35.765722 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.766370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.767267 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.767730 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.875952 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.890289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.891979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.893215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-074dc88f-39a1-4c6e-8b12-f340d7e1b166 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.156060 Jun 15 14:43:35.893861 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 64/126] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:35 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:35.968967 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d0ae0d93-9cf1-4e3f-8b78-6dccfa2f3c30 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.979141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d0ae0d93-9cf1-4e3f-8b78-6dccfa2f3c30 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.240329 Jun 15 14:43:35.979791 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 63/127] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:35 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:36.402163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-61007571-304d-4330-8c77-3f2c6b78d600 req-dc5ed79e-dbeb-464d-93c8-9d91a94ff3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66", "name": "network-vif-plugged", "status": "completed", "tag": "0a0e535f-062d-49cb-ba26-271db8cdd8d9"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:36.410644 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-61007571-304d-4330-8c77-3f2c6b78d600 req-dc5ed79e-dbeb-464d-93c8-9d91a94ff3c5 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.411140 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-61007571-304d-4330-8c77-3f2c6b78d600 req-dc5ed79e-dbeb-464d-93c8-9d91a94ff3c5 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.423057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-61007571-304d-4330-8c77-3f2c6b78d600 req-dc5ed79e-dbeb-464d-93c8-9d91a94ff3c5 service nova] Creating event network-vif-plugged:0a0e535f-062d-49cb-ba26-271db8cdd8d9 for instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 on hv-cinder-80382 Jun 15 14:43:36.428887 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-61007571-304d-4330-8c77-3f2c6b78d600 req-dc5ed79e-dbeb-464d-93c8-9d91a94ff3c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088029 Jun 15 14:43:36.429572 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 65/128] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:36.751943 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3a56eca4-0d96-4db6-bdfa-74ab41004706 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:36.752557 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3a56eca4-0d96-4db6-bdfa-74ab41004706 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:36.760080 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3a56eca4-0d96-4db6-bdfa-74ab41004706 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.760525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3a56eca4-0d96-4db6-bdfa-74ab41004706 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.761328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3a56eca4-0d96-4db6-bdfa-74ab41004706 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.761724 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3a56eca4-0d96-4db6-bdfa-74ab41004706 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.763587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1fce9d42-4990-4949-881c-93f68c307dfb tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:36.764759 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1fce9d42-4990-4949-881c-93f68c307dfb tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:36.772853 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fce9d42-4990-4949-881c-93f68c307dfb tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.773392 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fce9d42-4990-4949-881c-93f68c307dfb tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.774431 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fce9d42-4990-4949-881c-93f68c307dfb tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.775025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fce9d42-4990-4949-881c-93f68c307dfb tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.977030 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3a56eca4-0d96-4db6-bdfa-74ab41004706 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:36.981035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1fce9d42-4990-4949-881c-93f68c307dfb tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:36.984906 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3a56eca4-0d96-4db6-bdfa-74ab41004706 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.236937 Jun 15 14:43:36.985492 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 64/129] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:36 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:36.991765 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:36.991765 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:36.995741 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1fce9d42-4990-4949-881c-93f68c307dfb tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.235607 Jun 15 14:43:36.996370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 66/130] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:36 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:36.998294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.998781 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.999937 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:37.000114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:37.001706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cfd02c26-d30b-4efe-ae27-03d483391340 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:37.002310 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cfd02c26-d30b-4efe-ae27-03d483391340 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:37.009169 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cfd02c26-d30b-4efe-ae27-03d483391340 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:37.009619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cfd02c26-d30b-4efe-ae27-03d483391340 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:37.010392 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cfd02c26-d30b-4efe-ae27-03d483391340 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:37.010827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cfd02c26-d30b-4efe-ae27-03d483391340 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:37.067436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.076629 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.078567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.079946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1b09bb39-545a-46fb-9081-9e9b8512bb5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.093514 Jun 15 14:43:37.080703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 65/131] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:36 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:37.175030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cfd02c26-d30b-4efe-ae27-03d483391340 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.182810 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cfd02c26-d30b-4efe-ae27-03d483391340 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.185153 Jun 15 14:43:37.183558 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 67/132] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:36 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:38.003156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7929cb24-2ec2-4eaa-9cac-cf5d8f488580 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:38.003761 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7929cb24-2ec2-4eaa-9cac-cf5d8f488580 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:38.009931 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7929cb24-2ec2-4eaa-9cac-cf5d8f488580 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.010376 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7929cb24-2ec2-4eaa-9cac-cf5d8f488580 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.011165 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eb2e1232-1d2b-451a-98bc-aeb82ff39026 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:38.011635 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7929cb24-2ec2-4eaa-9cac-cf5d8f488580 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.011635 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7929cb24-2ec2-4eaa-9cac-cf5d8f488580 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.011785 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-eb2e1232-1d2b-451a-98bc-aeb82ff39026 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:38.017929 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb2e1232-1d2b-451a-98bc-aeb82ff39026 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.018384 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb2e1232-1d2b-451a-98bc-aeb82ff39026 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.019184 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb2e1232-1d2b-451a-98bc-aeb82ff39026 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.019621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb2e1232-1d2b-451a-98bc-aeb82ff39026 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.227360 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7929cb24-2ec2-4eaa-9cac-cf5d8f488580 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:38.239418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7929cb24-2ec2-4eaa-9cac-cf5d8f488580 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.239367 Jun 15 14:43:38.239997 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 66/133] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:37 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:38.251868 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-eb2e1232-1d2b-451a-98bc-aeb82ff39026 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:38.261773 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-eb2e1232-1d2b-451a-98bc-aeb82ff39026 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.253257 Jun 15 14:43:38.261890 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:38.262431 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:38.263722 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 68/134] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:38 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:38.270361 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.271625 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.272731 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3acc466f-e456-447a-a14d-2284c58f36d2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:38.273397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.273660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3acc466f-e456-447a-a14d-2284c58f36d2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:38.274517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.284205 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3acc466f-e456-447a-a14d-2284c58f36d2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.284672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3acc466f-e456-447a-a14d-2284c58f36d2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.285818 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3acc466f-e456-447a-a14d-2284c58f36d2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.286240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3acc466f-e456-447a-a14d-2284c58f36d2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.343665 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:38.357549 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:38.359426 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:38.360797 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7c5877c2-fbbe-4ade-8dd8-a00afbd94d5e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.103269 Jun 15 14:43:38.362050 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 67/135] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:38 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:38.460730 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3acc466f-e456-447a-a14d-2284c58f36d2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:38.468341 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3acc466f-e456-447a-a14d-2284c58f36d2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.201346 Jun 15 14:43:38.468908 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 69/136] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:38 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:39.258951 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ef1eb00f-f858-4cab-8452-71f4232ce86b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:39.259600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ef1eb00f-f858-4cab-8452-71f4232ce86b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:39.265780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef1eb00f-f858-4cab-8452-71f4232ce86b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.266235 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef1eb00f-f858-4cab-8452-71f4232ce86b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.267011 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef1eb00f-f858-4cab-8452-71f4232ce86b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.267442 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef1eb00f-f858-4cab-8452-71f4232ce86b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.280581 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-688f6035-a850-4cfc-b599-0f1628291293 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:39.281708 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-688f6035-a850-4cfc-b599-0f1628291293 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:39.299578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-688f6035-a850-4cfc-b599-0f1628291293 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.300030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-688f6035-a850-4cfc-b599-0f1628291293 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.300805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-688f6035-a850-4cfc-b599-0f1628291293 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.301234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-688f6035-a850-4cfc-b599-0f1628291293 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.492584 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ef1eb00f-f858-4cab-8452-71f4232ce86b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.497997 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-688f6035-a850-4cfc-b599-0f1628291293 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.500471 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ef1eb00f-f858-4cab-8452-71f4232ce86b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.245902 Jun 15 14:43:39.501125 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 68/137] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:39 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:39.506787 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:39.507551 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:39.512630 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-688f6035-a850-4cfc-b599-0f1628291293 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.238272 Jun 15 14:43:39.513725 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 70/138] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:39 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:39.514018 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.514321 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.515199 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.515706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.527394 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1cb88095-7781-44c8-b71f-6a89a1fecf0c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:39.528518 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1cb88095-7781-44c8-b71f-6a89a1fecf0c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:39.539282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1cb88095-7781-44c8-b71f-6a89a1fecf0c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.540093 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1cb88095-7781-44c8-b71f-6a89a1fecf0c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.541436 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1cb88095-7781-44c8-b71f-6a89a1fecf0c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.542362 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1cb88095-7781-44c8-b71f-6a89a1fecf0c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.593093 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.602700 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.604560 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.605740 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cdc39d4a-0d51-47d0-badd-3fda5ccc55b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.103499 Jun 15 14:43:39.606294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 69/139] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:39 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:39.700860 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1cb88095-7781-44c8-b71f-6a89a1fecf0c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.709226 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1cb88095-7781-44c8-b71f-6a89a1fecf0c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.192114 Jun 15 14:43:39.709810 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 71/140] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:39 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:40.518221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-82ac1990-2d7f-4d37-9930-93eae9c9e10b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:40.518830 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-82ac1990-2d7f-4d37-9930-93eae9c9e10b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:40.525142 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-82ac1990-2d7f-4d37-9930-93eae9c9e10b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.525589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-82ac1990-2d7f-4d37-9930-93eae9c9e10b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.526617 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-82ac1990-2d7f-4d37-9930-93eae9c9e10b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.527096 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-82ac1990-2d7f-4d37-9930-93eae9c9e10b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.529749 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-79a713e8-2689-4382-9c6e-0d7e033a3815 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:40.530474 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-79a713e8-2689-4382-9c6e-0d7e033a3815 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:40.537660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-79a713e8-2689-4382-9c6e-0d7e033a3815 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.538114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-79a713e8-2689-4382-9c6e-0d7e033a3815 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.538868 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-79a713e8-2689-4382-9c6e-0d7e033a3815 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.539328 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-79a713e8-2689-4382-9c6e-0d7e033a3815 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.724995 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-82ac1990-2d7f-4d37-9930-93eae9c9e10b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.728189 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-79a713e8-2689-4382-9c6e-0d7e033a3815 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.733213 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-82ac1990-2d7f-4d37-9930-93eae9c9e10b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.218847 Jun 15 14:43:40.734110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 70/141] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:40 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:40.735971 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-79a713e8-2689-4382-9c6e-0d7e033a3815 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.210211 Jun 15 14:43:40.737008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 72/142] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:40 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:40.741819 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-af6c8e7a-c13f-4185-b3d2-ab03465e4b04 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:40.742693 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-af6c8e7a-c13f-4185-b3d2-ab03465e4b04 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:40.747523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:40.748314 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:40.748629 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af6c8e7a-c13f-4185-b3d2-ab03465e4b04 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.748889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af6c8e7a-c13f-4185-b3d2-ab03465e4b04 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.749654 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af6c8e7a-c13f-4185-b3d2-ab03465e4b04 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.750078 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af6c8e7a-c13f-4185-b3d2-ab03465e4b04 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.754560 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.757428 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.757428 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.757428 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.766763 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:40.844866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.853712 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.855255 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.856376 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6fb21c85-f244-478e-819c-6826e368da00 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.121326 Jun 15 14:43:40.856936 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 71/143] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:40 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:40.923833 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-af6c8e7a-c13f-4185-b3d2-ab03465e4b04 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.932817 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-af6c8e7a-c13f-4185-b3d2-ab03465e4b04 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.194565 Jun 15 14:43:40.933475 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 73/144] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:40 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:41.750174 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7c0f13b2-abec-41d4-b29b-a448e191ab0b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:41.750815 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7c0f13b2-abec-41d4-b29b-a448e191ab0b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:41.752454 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7436ab6a-a585-494a-99e0-2b26ba8521d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:41.752867 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:41.753066 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7436ab6a-a585-494a-99e0-2b26ba8521d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:41.760132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7436ab6a-a585-494a-99e0-2b26ba8521d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.760549 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c0f13b2-abec-41d4-b29b-a448e191ab0b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.760672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7436ab6a-a585-494a-99e0-2b26ba8521d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.761001 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c0f13b2-abec-41d4-b29b-a448e191ab0b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.761419 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7436ab6a-a585-494a-99e0-2b26ba8521d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.761764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c0f13b2-abec-41d4-b29b-a448e191ab0b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.761857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7436ab6a-a585-494a-99e0-2b26ba8521d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.762199 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c0f13b2-abec-41d4-b29b-a448e191ab0b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.961253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7c0f13b2-abec-41d4-b29b-a448e191ab0b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:41.968767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7436ab6a-a585-494a-99e0-2b26ba8521d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:41.971157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7c0f13b2-abec-41d4-b29b-a448e191ab0b tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.224735 Jun 15 14:43:41.971876 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 72/145] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:41 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:41.977041 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:41.977656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:41.983980 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7436ab6a-a585-494a-99e0-2b26ba8521d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.235150 Jun 15 14:43:41.985956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.986406 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.987304 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.987740 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.994724 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 74/146] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:41 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:41.999561 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7e410f27-5fbd-4852-8d16-3006c42b7fc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:42.000166 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7e410f27-5fbd-4852-8d16-3006c42b7fc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:42.006766 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7e410f27-5fbd-4852-8d16-3006c42b7fc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.007243 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7e410f27-5fbd-4852-8d16-3006c42b7fc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:42.008114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7e410f27-5fbd-4852-8d16-3006c42b7fc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.009045 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7e410f27-5fbd-4852-8d16-3006c42b7fc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:42.069874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:42.078653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:42.080824 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:42.081397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-12d2b08d-b435-4b51-8a62-c45001d0cc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.108644 Jun 15 14:43:42.082191 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 73/147] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:41 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:42.195296 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7e410f27-5fbd-4852-8d16-3006c42b7fc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:42.204278 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7e410f27-5fbd-4852-8d16-3006c42b7fc9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.208412 Jun 15 14:43:42.204855 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 75/148] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:41 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:42.988899 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5de12021-15ae-40ed-99ea-6a807ac0bb9d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:42.990397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5de12021-15ae-40ed-99ea-6a807ac0bb9d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:43.000432 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5de12021-15ae-40ed-99ea-6a807ac0bb9d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.000887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5de12021-15ae-40ed-99ea-6a807ac0bb9d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.001666 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5de12021-15ae-40ed-99ea-6a807ac0bb9d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.002096 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5de12021-15ae-40ed-99ea-6a807ac0bb9d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.002285 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ab658403-94c7-49ac-afcf-e47fde2fbad1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:43.002880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ab658403-94c7-49ac-afcf-e47fde2fbad1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:43.010596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab658403-94c7-49ac-afcf-e47fde2fbad1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.011260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab658403-94c7-49ac-afcf-e47fde2fbad1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.012128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab658403-94c7-49ac-afcf-e47fde2fbad1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.012634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab658403-94c7-49ac-afcf-e47fde2fbad1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.214127 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5de12021-15ae-40ed-99ea-6a807ac0bb9d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:43.221690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ab658403-94c7-49ac-afcf-e47fde2fbad1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:43.227399 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5de12021-15ae-40ed-99ea-6a807ac0bb9d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.242584 Jun 15 14:43:43.227980 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 74/149] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:42 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:43.229834 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ab658403-94c7-49ac-afcf-e47fde2fbad1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.231726 Jun 15 14:43:43.233399 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:43.234251 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:43.237835 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 76/150] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:42 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:43.241824 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.242286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.245132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.245132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.245520 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4ec1fab6-32a7-49b2-9988-5107c1b76fa8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:43.245520 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4ec1fab6-32a7-49b2-9988-5107c1b76fa8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:43.257299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ec1fab6-32a7-49b2-9988-5107c1b76fa8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.258098 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ec1fab6-32a7-49b2-9988-5107c1b76fa8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.258875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ec1fab6-32a7-49b2-9988-5107c1b76fa8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.259341 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ec1fab6-32a7-49b2-9988-5107c1b76fa8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.315620 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:43.325649 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:43.327350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:43.328761 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1282a9d4-9e9d-47ad-8fe9-a60e1b355356 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.099285 Jun 15 14:43:43.329428 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 75/151] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:43 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:43.424953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4ec1fab6-32a7-49b2-9988-5107c1b76fa8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:43.432402 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4ec1fab6-32a7-49b2-9988-5107c1b76fa8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.193227 Jun 15 14:43:43.432968 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 77/152] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:43 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:44.008949 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-ab2fc627-2acf-4c76-8595-6d6bd5bf029f req-401cdb5b-72c3-4903-98f1-5d94c8cd4eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6db7511-cad4-4d72-8939-8dd1483150d1", "name": "network-vif-plugged", "status": "completed", "tag": "3fed3571-ad3e-487a-9939-29301e865daa"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:44.028210 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-ab2fc627-2acf-4c76-8595-6d6bd5bf029f req-401cdb5b-72c3-4903-98f1-5d94c8cd4eb8 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.029441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-ab2fc627-2acf-4c76-8595-6d6bd5bf029f req-401cdb5b-72c3-4903-98f1-5d94c8cd4eb8 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.049977 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-ab2fc627-2acf-4c76-8595-6d6bd5bf029f req-401cdb5b-72c3-4903-98f1-5d94c8cd4eb8 service nova] Creating event network-vif-plugged:3fed3571-ad3e-487a-9939-29301e865daa for instance d6db7511-cad4-4d72-8939-8dd1483150d1 on hv-cinder-80382 Jun 15 14:43:44.057200 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-ab2fc627-2acf-4c76-8595-6d6bd5bf029f req-401cdb5b-72c3-4903-98f1-5d94c8cd4eb8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055318 Jun 15 14:43:44.058006 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 76/153] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:44.247987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7067bd10-90f6-414f-9a4d-3f524aa36076 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:44.247987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7067bd10-90f6-414f-9a4d-3f524aa36076 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:44.248494 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f0242661-635d-42ec-a677-6369b43e667c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:44.249042 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f0242661-635d-42ec-a677-6369b43e667c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:44.252837 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7067bd10-90f6-414f-9a4d-3f524aa36076 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.253291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7067bd10-90f6-414f-9a4d-3f524aa36076 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.254269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7067bd10-90f6-414f-9a4d-3f524aa36076 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.254934 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7067bd10-90f6-414f-9a4d-3f524aa36076 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.256285 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f0242661-635d-42ec-a677-6369b43e667c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.256741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f0242661-635d-42ec-a677-6369b43e667c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.257534 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f0242661-635d-42ec-a677-6369b43e667c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.258004 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f0242661-635d-42ec-a677-6369b43e667c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.494002 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7067bd10-90f6-414f-9a4d-3f524aa36076 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.509193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7067bd10-90f6-414f-9a4d-3f524aa36076 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.268110 Jun 15 14:43:44.513735 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f0242661-635d-42ec-a677-6369b43e667c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.517983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=100 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:44.523629 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 78/154] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:44 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:44.530680 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f0242661-635d-42ec-a677-6369b43e667c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.287168 Jun 15 14:43:44.543166 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 77/155] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:44 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:44.544553 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:44.544553 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:44.554217 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.555287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.556795 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.558057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.562278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-dee4dffe-69a3-4ab8-80d4-7030851df7a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:44.563948 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-dee4dffe-69a3-4ab8-80d4-7030851df7a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:44.581005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dee4dffe-69a3-4ab8-80d4-7030851df7a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.581468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dee4dffe-69a3-4ab8-80d4-7030851df7a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.582253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dee4dffe-69a3-4ab8-80d4-7030851df7a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.582692 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dee4dffe-69a3-4ab8-80d4-7030851df7a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.654660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.668155 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.669898 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.671373 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-92ae8ebf-344a-484a-9d71-b268689231cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1332 microversion: 2.20 time: 0.146317 Jun 15 14:43:44.672416 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 79/156] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:44 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:44.769498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-dee4dffe-69a3-4ab8-80d4-7030851df7a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.783947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-dee4dffe-69a3-4ab8-80d4-7030851df7a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.236905 Jun 15 14:43:44.784758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 78/157] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:44 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:45.540904 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-466f793c-d8e2-48be-ae1d-9997b7459df7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:45.541649 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-466f793c-d8e2-48be-ae1d-9997b7459df7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:45.543595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:45.557037 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-466f793c-d8e2-48be-ae1d-9997b7459df7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.558430 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-466f793c-d8e2-48be-ae1d-9997b7459df7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.559423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-466f793c-d8e2-48be-ae1d-9997b7459df7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.560152 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-466f793c-d8e2-48be-ae1d-9997b7459df7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.562962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-def6cd4d-d84a-4e7c-a71f-639be133f6fc tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:45.563846 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-def6cd4d-d84a-4e7c-a71f-639be133f6fc tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:45.577536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-def6cd4d-d84a-4e7c-a71f-639be133f6fc tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.578282 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-def6cd4d-d84a-4e7c-a71f-639be133f6fc tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.579379 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-def6cd4d-d84a-4e7c-a71f-639be133f6fc tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.579695 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-def6cd4d-d84a-4e7c-a71f-639be133f6fc tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.985952 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-466f793c-d8e2-48be-ae1d-9997b7459df7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.001729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-466f793c-d8e2-48be-ae1d-9997b7459df7 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.463585 Jun 15 14:43:46.002925 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 80/158] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:45 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:46.019518 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:46.022734 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:46.039995 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.040648 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.041652 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.042259 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.123876 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-def6cd4d-d84a-4e7c-a71f-639be133f6fc tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.151831 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-def6cd4d-d84a-4e7c-a71f-639be133f6fc tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.593743 Jun 15 14:43:46.168452 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 79/159] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:45 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:46.179833 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b22d4f05-2eae-4b64-9bc5-c8e876050d20 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:46.180443 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b22d4f05-2eae-4b64-9bc5-c8e876050d20 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:46.187025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.187343 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b22d4f05-2eae-4b64-9bc5-c8e876050d20 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.187994 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b22d4f05-2eae-4b64-9bc5-c8e876050d20 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.188989 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b22d4f05-2eae-4b64-9bc5-c8e876050d20 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.189606 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b22d4f05-2eae-4b64-9bc5-c8e876050d20 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.225783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.234358 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.237987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5c8af724-3080-49ba-8cf9-85c9f33e0776 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1338 microversion: 2.20 time: 0.233606 Jun 15 14:43:46.242797 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 81/160] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:46 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1338 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:46.554886 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b22d4f05-2eae-4b64-9bc5-c8e876050d20 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.566661 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b22d4f05-2eae-4b64-9bc5-c8e876050d20 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.394381 Jun 15 14:43:46.570543 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 80/161] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:46 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:47.020098 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4e5bab6d-d9ca-4422-b010-b0507bab06f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:47.021271 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4e5bab6d-d9ca-4422-b010-b0507bab06f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:47.030833 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e5bab6d-d9ca-4422-b010-b0507bab06f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.031314 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e5bab6d-d9ca-4422-b010-b0507bab06f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.032084 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e5bab6d-d9ca-4422-b010-b0507bab06f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.035540 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e5bab6d-d9ca-4422-b010-b0507bab06f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.175372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-28649b22-7a36-49b0-a454-04bb10cd39d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:47.176315 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-28649b22-7a36-49b0-a454-04bb10cd39d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:47.183872 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28649b22-7a36-49b0-a454-04bb10cd39d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.184631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28649b22-7a36-49b0-a454-04bb10cd39d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.185406 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28649b22-7a36-49b0-a454-04bb10cd39d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.185908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28649b22-7a36-49b0-a454-04bb10cd39d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.396681 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4e5bab6d-d9ca-4422-b010-b0507bab06f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.407193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4e5bab6d-d9ca-4422-b010-b0507bab06f1 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.390848 Jun 15 14:43:47.408353 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 82/162] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:47 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:47.421493 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:47.422102 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:47.433420 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.433875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.434642 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.436607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.703810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-28649b22-7a36-49b0-a454-04bb10cd39d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.714644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-28649b22-7a36-49b0-a454-04bb10cd39d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.543166 Jun 15 14:43:47.715268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 81/163] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:47 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:47.730177 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-01907366-85a8-418c-8435-e1d571349866 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:47.730781 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-01907366-85a8-418c-8435-e1d571349866 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:47.749931 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-01907366-85a8-418c-8435-e1d571349866 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.750630 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-01907366-85a8-418c-8435-e1d571349866 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.751494 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-01907366-85a8-418c-8435-e1d571349866 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.752434 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-01907366-85a8-418c-8435-e1d571349866 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.755554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.766300 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.768048 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.769338 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-14c15134-70a6-4701-8329-26ed7b159616 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.359523 Jun 15 14:43:47.769951 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 83/164] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:47 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:47.966027 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-01907366-85a8-418c-8435-e1d571349866 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.979706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-01907366-85a8-418c-8435-e1d571349866 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.256788 Jun 15 14:43:47.980846 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 82/165] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:47 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:48.424250 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6a90aeac-ae35-43bc-b312-21343f243e4c tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:48.424860 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6a90aeac-ae35-43bc-b312-21343f243e4c tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:48.432944 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6a90aeac-ae35-43bc-b312-21343f243e4c tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.433421 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6a90aeac-ae35-43bc-b312-21343f243e4c tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.434147 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6a90aeac-ae35-43bc-b312-21343f243e4c tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.434587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6a90aeac-ae35-43bc-b312-21343f243e4c tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.699385 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6a90aeac-ae35-43bc-b312-21343f243e4c tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:48.711269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6a90aeac-ae35-43bc-b312-21343f243e4c tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.289394 Jun 15 14:43:48.721473 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 84/166] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:48 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:48.735868 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6bde4aaf-aea2-4547-9db4-99fa38dcfc50 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:48.736508 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6bde4aaf-aea2-4547-9db4-99fa38dcfc50 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:48.742834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6bde4aaf-aea2-4547-9db4-99fa38dcfc50 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.743341 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6bde4aaf-aea2-4547-9db4-99fa38dcfc50 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.744305 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6bde4aaf-aea2-4547-9db4-99fa38dcfc50 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.745392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6bde4aaf-aea2-4547-9db4-99fa38dcfc50 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.791082 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:48.791798 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:48.801545 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.802755 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.803781 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.805147 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.066757 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:49.086854 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:49.088768 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:49.089694 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6bde4aaf-aea2-4547-9db4-99fa38dcfc50 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:49.089910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d39bd49c-43ad-4c44-a410-3d990cfc5754 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.304527 Jun 15 14:43:49.090788 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 85/167] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:48 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:49.095532 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c340a99d-a1c9-4894-a36b-5a2c63f2d717 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:49.096354 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c340a99d-a1c9-4894-a36b-5a2c63f2d717 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:49.103307 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c340a99d-a1c9-4894-a36b-5a2c63f2d717 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.104322 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c340a99d-a1c9-4894-a36b-5a2c63f2d717 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.105757 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c340a99d-a1c9-4894-a36b-5a2c63f2d717 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.106276 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6bde4aaf-aea2-4547-9db4-99fa38dcfc50 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.378194 Jun 15 14:43:49.106655 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c340a99d-a1c9-4894-a36b-5a2c63f2d717 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.106874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 83/168] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:48 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:49.324520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-788bc911-f135-4793-8969-d83b91330fe2 req-7f010878-1af4-4cd8-bb9a-c43892b657ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75215a3c-bc0f-4e8b-9c52-a35946a5bfb1", "tag": "e62eb4f5-3c82-41c8-bbba-4140a119e597"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:49.339695 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-788bc911-f135-4793-8969-d83b91330fe2 req-7f010878-1af4-4cd8-bb9a-c43892b657ea service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.340862 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-788bc911-f135-4793-8969-d83b91330fe2 req-7f010878-1af4-4cd8-bb9a-c43892b657ea service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.359319 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c340a99d-a1c9-4894-a36b-5a2c63f2d717 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:49.360089 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-788bc911-f135-4793-8969-d83b91330fe2 req-7f010878-1af4-4cd8-bb9a-c43892b657ea service nova] Creating event network-changed:e62eb4f5-3c82-41c8-bbba-4140a119e597 for instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 on hv-cinder-80382 Jun 15 14:43:49.369336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c340a99d-a1c9-4894-a36b-5a2c63f2d717 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.277235 Jun 15 14:43:49.373246 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 86/169] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:49 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:49.376365 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-788bc911-f135-4793-8969-d83b91330fe2 req-7f010878-1af4-4cd8-bb9a-c43892b657ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055568 Jun 15 14:43:49.378703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 84/170] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:49.734848 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-030c6533-e08f-4926-89d2-432ad835670e tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:49.735720 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-030c6533-e08f-4926-89d2-432ad835670e tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:49.742565 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-030c6533-e08f-4926-89d2-432ad835670e tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.743049 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-030c6533-e08f-4926-89d2-432ad835670e tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.744231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-030c6533-e08f-4926-89d2-432ad835670e tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.744365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-030c6533-e08f-4926-89d2-432ad835670e tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.896199 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-030c6533-e08f-4926-89d2-432ad835670e tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:49.904520 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-030c6533-e08f-4926-89d2-432ad835670e tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.174893 Jun 15 14:43:49.905263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 87/171] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:49 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:50.110014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:50.110715 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:50.119772 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.120230 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.121007 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.121443 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.122852 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0f42b64f-fca3-4ba0-a804-980611f5744b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:50.123512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0f42b64f-fca3-4ba0-a804-980611f5744b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:50.131925 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0f42b64f-fca3-4ba0-a804-980611f5744b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.132319 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0f42b64f-fca3-4ba0-a804-980611f5744b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.133171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0f42b64f-fca3-4ba0-a804-980611f5744b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.133524 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0f42b64f-fca3-4ba0-a804-980611f5744b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.330650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.338282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0f42b64f-fca3-4ba0-a804-980611f5744b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.339742 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.341246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.342332 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d84506d6-046c-4504-8d3a-5203433aebc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.237276 Jun 15 14:43:50.342901 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 85/172] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:50 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:50.345667 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0f42b64f-fca3-4ba0-a804-980611f5744b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.226562 Jun 15 14:43:50.346224 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 88/173] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:50 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:50.387892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-46cd7570-4f63-4579-bcfc-9b875ee7c52c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:50.388488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-46cd7570-4f63-4579-bcfc-9b875ee7c52c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:50.394391 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-46cd7570-4f63-4579-bcfc-9b875ee7c52c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.394835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-46cd7570-4f63-4579-bcfc-9b875ee7c52c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.396240 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-46cd7570-4f63-4579-bcfc-9b875ee7c52c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.396671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-46cd7570-4f63-4579-bcfc-9b875ee7c52c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.530611 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-46cd7570-4f63-4579-bcfc-9b875ee7c52c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.539132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-46cd7570-4f63-4579-bcfc-9b875ee7c52c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.154876 Jun 15 14:43:50.539701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 86/174] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:50 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:50.922097 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fc6776b8-f3a9-4315-b8f5-993180c114af tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:50.922747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fc6776b8-f3a9-4315-b8f5-993180c114af tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:50.929424 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6776b8-f3a9-4315-b8f5-993180c114af tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.929992 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6776b8-f3a9-4315-b8f5-993180c114af tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.930766 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6776b8-f3a9-4315-b8f5-993180c114af tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.931232 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6776b8-f3a9-4315-b8f5-993180c114af tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.062945 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc6776b8-f3a9-4315-b8f5-993180c114af tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.073539 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fc6776b8-f3a9-4315-b8f5-993180c114af tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.155077 Jun 15 14:43:51.074431 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 89/175] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:50 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:51.359941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:51.360666 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:51.362261 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-31de0c1b-6896-4ba8-afa2-ccb8a5552a8d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:51.363234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-31de0c1b-6896-4ba8-afa2-ccb8a5552a8d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:51.368627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.369185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.370052 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.370567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.372095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31de0c1b-6896-4ba8-afa2-ccb8a5552a8d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.372845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31de0c1b-6896-4ba8-afa2-ccb8a5552a8d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.374039 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31de0c1b-6896-4ba8-afa2-ccb8a5552a8d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.376112 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31de0c1b-6896-4ba8-afa2-ccb8a5552a8d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.381521 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:51.595968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.606549 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.609215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.610428 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7c6d56df-5a4f-460c-805e-6c01f4f6b9e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.254424 Jun 15 14:43:51.611111 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-31de0c1b-6896-4ba8-afa2-ccb8a5552a8d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.621583 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 87/176] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:51 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:51.623416 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-31de0c1b-6896-4ba8-afa2-ccb8a5552a8d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.265590 Jun 15 14:43:51.624008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 90/177] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:51 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:51.626576 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0e9f9c8f-87b9-43e1-842c-cf7b20d26e24 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:51.627213 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0e9f9c8f-87b9-43e1-842c-cf7b20d26e24 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:51.634592 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e9f9c8f-87b9-43e1-842c-cf7b20d26e24 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.635077 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e9f9c8f-87b9-43e1-842c-cf7b20d26e24 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.635876 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e9f9c8f-87b9-43e1-842c-cf7b20d26e24 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.636300 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e9f9c8f-87b9-43e1-842c-cf7b20d26e24 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.816536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0e9f9c8f-87b9-43e1-842c-cf7b20d26e24 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.828146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0e9f9c8f-87b9-43e1-842c-cf7b20d26e24 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.205385 Jun 15 14:43:51.829014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 88/178] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:51 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:52.092017 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fc29ac14-35a1-4abe-9815-9e3dc5ea5777 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:52.092754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fc29ac14-35a1-4abe-9815-9e3dc5ea5777 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:52.099472 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc29ac14-35a1-4abe-9815-9e3dc5ea5777 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.099932 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc29ac14-35a1-4abe-9815-9e3dc5ea5777 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.100698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc29ac14-35a1-4abe-9815-9e3dc5ea5777 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.101133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc29ac14-35a1-4abe-9815-9e3dc5ea5777 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.241662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc29ac14-35a1-4abe-9815-9e3dc5ea5777 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.249160 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fc29ac14-35a1-4abe-9815-9e3dc5ea5777 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.161124 Jun 15 14:43:52.249720 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 91/179] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:52 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:52.630979 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:52.632337 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:52.639687 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.640365 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.641350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.641974 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.644666 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1d586680-4c4e-4239-a8d1-2700fde5ee39 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:52.645267 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1d586680-4c4e-4239-a8d1-2700fde5ee39 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:52.652468 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d586680-4c4e-4239-a8d1-2700fde5ee39 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.652972 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d586680-4c4e-4239-a8d1-2700fde5ee39 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.653736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d586680-4c4e-4239-a8d1-2700fde5ee39 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.654164 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d586680-4c4e-4239-a8d1-2700fde5ee39 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.862108 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.865184 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1d586680-4c4e-4239-a8d1-2700fde5ee39 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.870220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.871900 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.873177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1d586680-4c4e-4239-a8d1-2700fde5ee39 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.232243 Jun 15 14:43:52.873820 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 92/180] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:52 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:52.878367 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f701a7d5-e46d-4524-8b6a-4148f7641bde tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:52.878880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f701a7d5-e46d-4524-8b6a-4148f7641bde tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:52.884519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1a1c78db-43c2-4566-a0fa-d97d2964b0da tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.259537 Jun 15 14:43:52.885165 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 89/181] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:52 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:52.885301 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f701a7d5-e46d-4524-8b6a-4148f7641bde tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.885705 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f701a7d5-e46d-4524-8b6a-4148f7641bde tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.886868 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f701a7d5-e46d-4524-8b6a-4148f7641bde tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.887357 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f701a7d5-e46d-4524-8b6a-4148f7641bde tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.055277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f701a7d5-e46d-4524-8b6a-4148f7641bde tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:53.062647 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f701a7d5-e46d-4524-8b6a-4148f7641bde tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.187890 Jun 15 14:43:53.063430 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 93/182] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:52 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:53.265563 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d57a370e-6409-49de-8e50-c86df56b1ae6 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:53.266164 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d57a370e-6409-49de-8e50-c86df56b1ae6 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:53.272210 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d57a370e-6409-49de-8e50-c86df56b1ae6 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.272653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d57a370e-6409-49de-8e50-c86df56b1ae6 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.273459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d57a370e-6409-49de-8e50-c86df56b1ae6 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.273888 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d57a370e-6409-49de-8e50-c86df56b1ae6 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.403567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d57a370e-6409-49de-8e50-c86df56b1ae6 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:53.410938 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d57a370e-6409-49de-8e50-c86df56b1ae6 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1315 microversion: 2.1 time: 0.149214 Jun 15 14:43:53.411684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 90/183] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:53 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:53.889147 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4327b450-f04b-4836-920a-b0cad883d3aa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:53.889845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4327b450-f04b-4836-920a-b0cad883d3aa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:53.897472 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4327b450-f04b-4836-920a-b0cad883d3aa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.898089 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4327b450-f04b-4836-920a-b0cad883d3aa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.899028 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4327b450-f04b-4836-920a-b0cad883d3aa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.899609 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4327b450-f04b-4836-920a-b0cad883d3aa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.902322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:53.903010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:53.909044 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.909718 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.910536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.911852 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.332214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:54.341045 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4327b450-f04b-4836-920a-b0cad883d3aa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:54.341962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:54.343603 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:54.344855 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f23b7e8c-f157-470e-8faa-a4132cf4f5e5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.446736 Jun 15 14:43:54.345473 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 91/184] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:53 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:43:54.350738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-08f3196a-347d-46ac-b411-206fa2d645c7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:54.351367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-08f3196a-347d-46ac-b411-206fa2d645c7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:54.357271 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4327b450-f04b-4836-920a-b0cad883d3aa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.471906 Jun 15 14:43:54.357499 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-08f3196a-347d-46ac-b411-206fa2d645c7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.357946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-08f3196a-347d-46ac-b411-206fa2d645c7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.358132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 94/185] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:53 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:54.359151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-08f3196a-347d-46ac-b411-206fa2d645c7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.359589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-08f3196a-347d-46ac-b411-206fa2d645c7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.428768 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d4f7a63f-fbe4-440f-bcf3-04ec8b24558d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:54.429494 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d4f7a63f-fbe4-440f-bcf3-04ec8b24558d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:54.437662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4f7a63f-fbe4-440f-bcf3-04ec8b24558d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.438464 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4f7a63f-fbe4-440f-bcf3-04ec8b24558d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.439502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4f7a63f-fbe4-440f-bcf3-04ec8b24558d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.440167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4f7a63f-fbe4-440f-bcf3-04ec8b24558d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.628620 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-08f3196a-347d-46ac-b411-206fa2d645c7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:54.653746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-08f3196a-347d-46ac-b411-206fa2d645c7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.300661 Jun 15 14:43:54.654624 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 92/186] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:54 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:54.775286 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d4f7a63f-fbe4-440f-bcf3-04ec8b24558d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:54.784951 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d4f7a63f-fbe4-440f-bcf3-04ec8b24558d tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1501 microversion: 2.1 time: 0.360589 Jun 15 14:43:54.785806 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 95/187] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:54 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1501 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:54.922002 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-b95b3faf-e34c-4055-941c-2185f48c36f2 req-40ef27da-e0e9-40f0-bfe2-19d7779b8d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d16976b-b746-452b-b48d-b7a26950a19e", "name": "network-vif-plugged", "status": "completed", "tag": "24f578b6-7f09-4add-8d9b-74b34e954ebf"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:54.945950 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b95b3faf-e34c-4055-941c-2185f48c36f2 req-40ef27da-e0e9-40f0-bfe2-19d7779b8d54 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.946400 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b95b3faf-e34c-4055-941c-2185f48c36f2 req-40ef27da-e0e9-40f0-bfe2-19d7779b8d54 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.979691 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-b95b3faf-e34c-4055-941c-2185f48c36f2 req-40ef27da-e0e9-40f0-bfe2-19d7779b8d54 service nova] Creating event network-vif-plugged:24f578b6-7f09-4add-8d9b-74b34e954ebf for instance 1d16976b-b746-452b-b48d-b7a26950a19e on hv-cinder-80382 Jun 15 14:43:54.993923 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-b95b3faf-e34c-4055-941c-2185f48c36f2 req-40ef27da-e0e9-40f0-bfe2-19d7779b8d54 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075966 Jun 15 14:43:54.995018 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 93/188] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:55.366484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:55.367943 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:55.377065 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-70c3fa79-a1d8-4017-bc19-d13465ed6195 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:55.378519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-70c3fa79-a1d8-4017-bc19-d13465ed6195 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:55.378783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.379278 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.381599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.383567 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.394035 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70c3fa79-a1d8-4017-bc19-d13465ed6195 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.395685 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70c3fa79-a1d8-4017-bc19-d13465ed6195 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.399109 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70c3fa79-a1d8-4017-bc19-d13465ed6195 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.400911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70c3fa79-a1d8-4017-bc19-d13465ed6195 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.666050 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-70c3fa79-a1d8-4017-bc19-d13465ed6195 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.670105 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.674684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-70c3fa79-a1d8-4017-bc19-d13465ed6195 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.302595 Jun 15 14:43:55.675803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 94/189] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:55 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:55.686014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.687950 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a464ff9f-cb0c-4214-b77b-04332fb76bcc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:55.688492 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a464ff9f-cb0c-4214-b77b-04332fb76bcc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:55.688966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.690500 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4e66aec0-c211-4728-b884-dec4a5758c61 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.330650 Jun 15 14:43:55.691622 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 96/190] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:55 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:55.697020 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a464ff9f-cb0c-4214-b77b-04332fb76bcc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.698176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a464ff9f-cb0c-4214-b77b-04332fb76bcc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.699241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a464ff9f-cb0c-4214-b77b-04332fb76bcc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.699823 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a464ff9f-cb0c-4214-b77b-04332fb76bcc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.858510 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a464ff9f-cb0c-4214-b77b-04332fb76bcc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.860817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=100 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:55.867866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a464ff9f-cb0c-4214-b77b-04332fb76bcc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.191055 Jun 15 14:43:55.868446 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 95/191] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:55 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:56.399480 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eb876f0b-dbed-45fd-8846-53ce45031123 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "812085b7-d345-4072-baf8-c65d9f8f306a"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:56.400801 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-eb876f0b-dbed-45fd-8846-53ce45031123 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:56.408138 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb876f0b-dbed-45fd-8846-53ce45031123 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.408610 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb876f0b-dbed-45fd-8846-53ce45031123 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.409392 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb876f0b-dbed-45fd-8846-53ce45031123 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.409829 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb876f0b-dbed-45fd-8846-53ce45031123 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.692522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e40a50a4-e6d9-450c-9c09-45e94be4715f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:56.693539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e40a50a4-e6d9-450c-9c09-45e94be4715f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:56.699887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e40a50a4-e6d9-450c-9c09-45e94be4715f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.700423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e40a50a4-e6d9-450c-9c09-45e94be4715f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.701296 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e40a50a4-e6d9-450c-9c09-45e94be4715f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.701814 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e40a50a4-e6d9-450c-9c09-45e94be4715f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.838838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e40a50a4-e6d9-450c-9c09-45e94be4715f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:56.846458 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e40a50a4-e6d9-450c-9c09-45e94be4715f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.158628 Jun 15 14:43:56.855668 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 96/192] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:56 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:56.855668 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:56.855668 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:56.858008 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.858447 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.859224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.859652 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.994578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:57.008647 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:57.011974 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:57.013823 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6a45deb9-728b-4932-9aea-4ce0894f5260 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.165750 Jun 15 14:43:57.014719 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 97/193] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:56 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:57.019615 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f4078ac5-7ee5-4e74-906a-fab280535c0e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:57.020210 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f4078ac5-7ee5-4e74-906a-fab280535c0e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:57.027196 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f4078ac5-7ee5-4e74-906a-fab280535c0e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:57.027732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f4078ac5-7ee5-4e74-906a-fab280535c0e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:57.028702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f4078ac5-7ee5-4e74-906a-fab280535c0e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:57.029148 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f4078ac5-7ee5-4e74-906a-fab280535c0e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:57.192250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f4078ac5-7ee5-4e74-906a-fab280535c0e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:57.200928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f4078ac5-7ee5-4e74-906a-fab280535c0e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.185059 Jun 15 14:43:57.201494 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 98/194] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:57 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:57.862446 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4cfaab84-1299-4f04-b233-6c95d5cf3e25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:57.863080 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4cfaab84-1299-4f04-b233-6c95d5cf3e25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:57.869836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4cfaab84-1299-4f04-b233-6c95d5cf3e25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:57.870282 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4cfaab84-1299-4f04-b233-6c95d5cf3e25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:57.871084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4cfaab84-1299-4f04-b233-6c95d5cf3e25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:57.871522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4cfaab84-1299-4f04-b233-6c95d5cf3e25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.000600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4cfaab84-1299-4f04-b233-6c95d5cf3e25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:58.009249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4cfaab84-1299-4f04-b233-6c95d5cf3e25 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.150573 Jun 15 14:43:58.009935 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 99/195] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:57 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:58.032401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:58.033169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:58.039771 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.040215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.040967 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.041393 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.178188 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:58.187086 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:58.188627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:58.189735 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-941d7a92-b8a5-49c7-81e4-3c097c6ae0c0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.161134 Jun 15 14:43:58.190524 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 100/196] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:58 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:43:58.217976 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0b21b498-3f94-481f-9b70-bf7dd2dfffc5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:58.218574 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0b21b498-3f94-481f-9b70-bf7dd2dfffc5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:58.227153 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0b21b498-3f94-481f-9b70-bf7dd2dfffc5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.228088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0b21b498-3f94-481f-9b70-bf7dd2dfffc5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.229160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0b21b498-3f94-481f-9b70-bf7dd2dfffc5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.229890 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0b21b498-3f94-481f-9b70-bf7dd2dfffc5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.422088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0b21b498-3f94-481f-9b70-bf7dd2dfffc5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:58.430928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0b21b498-3f94-481f-9b70-bf7dd2dfffc5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.216853 Jun 15 14:43:58.431482 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 101/197] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:58 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:59.032587 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-09497985-681a-4362-aec7-c6442ac261f9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:59.033716 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-09497985-681a-4362-aec7-c6442ac261f9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:59.042495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-09497985-681a-4362-aec7-c6442ac261f9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.042984 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-09497985-681a-4362-aec7-c6442ac261f9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.043833 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-09497985-681a-4362-aec7-c6442ac261f9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.044273 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-09497985-681a-4362-aec7-c6442ac261f9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.181680 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-09497985-681a-4362-aec7-c6442ac261f9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.190847 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-09497985-681a-4362-aec7-c6442ac261f9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.165994 Jun 15 14:43:59.191665 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 102/198] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:59 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:59.207383 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:59.208593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:59.216056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.216507 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.217308 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.217740 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.352980 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.360861 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.362360 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.363481 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fd93fbb4-da5f-4d89-b7ac-6f575238412a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.160103 Jun 15 14:43:59.364059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 103/199] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:59 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:43:59.446593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-00a5adc4-619c-471d-9f18-03e1111d5808 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:59.447591 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-00a5adc4-619c-471d-9f18-03e1111d5808 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:59.453764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-00a5adc4-619c-471d-9f18-03e1111d5808 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.454226 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-00a5adc4-619c-471d-9f18-03e1111d5808 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.455012 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-00a5adc4-619c-471d-9f18-03e1111d5808 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.455462 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-00a5adc4-619c-471d-9f18-03e1111d5808 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.620619 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-00a5adc4-619c-471d-9f18-03e1111d5808 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.628306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-00a5adc4-619c-471d-9f18-03e1111d5808 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.185388 Jun 15 14:43:59.628875 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 104/200] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:59 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:00.209157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ef505a77-45bc-4dde-9a04-da57761f8438 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:00.209973 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ef505a77-45bc-4dde-9a04-da57761f8438 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:00.216292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef505a77-45bc-4dde-9a04-da57761f8438 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.216681 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef505a77-45bc-4dde-9a04-da57761f8438 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.217445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef505a77-45bc-4dde-9a04-da57761f8438 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.217881 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef505a77-45bc-4dde-9a04-da57761f8438 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.359592 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ef505a77-45bc-4dde-9a04-da57761f8438 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:00.367869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ef505a77-45bc-4dde-9a04-da57761f8438 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.163264 Jun 15 14:44:00.368439 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 105/201] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:00 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:00.383120 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:00.383888 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:00.390402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.390857 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.391664 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.392111 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.546402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:00.554912 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:00.558156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:00.559394 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5532332c-c73e-4b89-98a7-dd54bc5997b1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.181209 Jun 15 14:44:00.560068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 106/202] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:00 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:44:00.644833 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-efc66d5a-e7c5-4b4a-a59c-7032ae53b4e8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:00.645608 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-efc66d5a-e7c5-4b4a-a59c-7032ae53b4e8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:00.653231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-efc66d5a-e7c5-4b4a-a59c-7032ae53b4e8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.653231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-efc66d5a-e7c5-4b4a-a59c-7032ae53b4e8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.655532 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-efc66d5a-e7c5-4b4a-a59c-7032ae53b4e8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.655532 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-efc66d5a-e7c5-4b4a-a59c-7032ae53b4e8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.853029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-efc66d5a-e7c5-4b4a-a59c-7032ae53b4e8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:00.867628 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-efc66d5a-e7c5-4b4a-a59c-7032ae53b4e8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.225910 Jun 15 14:44:00.868418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 107/203] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:00 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:01.112813 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-eb876f0b-dbed-45fd-8846-53ce45031123 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "POST /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.716892 Jun 15 14:44:01.115361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 97/204] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:43:56 2022] POST /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1/os-volume_attachments => generated 194 bytes in 4722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:01.386292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b3cec1c0-9ee6-4a8a-b24c-137b1b2f0c71 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:01.387431 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b3cec1c0-9ee6-4a8a-b24c-137b1b2f0c71 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:01.395069 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b3cec1c0-9ee6-4a8a-b24c-137b1b2f0c71 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.395653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b3cec1c0-9ee6-4a8a-b24c-137b1b2f0c71 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.396779 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b3cec1c0-9ee6-4a8a-b24c-137b1b2f0c71 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.397202 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b3cec1c0-9ee6-4a8a-b24c-137b1b2f0c71 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.555363 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b3cec1c0-9ee6-4a8a-b24c-137b1b2f0c71 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:01.565823 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b3cec1c0-9ee6-4a8a-b24c-137b1b2f0c71 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.184436 Jun 15 14:44:01.566415 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 108/205] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:01 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:01.579241 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:01.579931 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:01.590133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.590133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.590133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.590133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.741902 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:01.753869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:01.757276 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:01.758692 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-eef1fde3-5bb8-4a88-a046-329f1b61729f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.183767 Jun 15 14:44:01.759427 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 98/206] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:01 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:01.887074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-625f165e-35d7-4ed2-923b-4b6b62dd3169 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:01.887875 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-625f165e-35d7-4ed2-923b-4b6b62dd3169 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:01.894304 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-625f165e-35d7-4ed2-923b-4b6b62dd3169 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.894761 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-625f165e-35d7-4ed2-923b-4b6b62dd3169 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.897157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-625f165e-35d7-4ed2-923b-4b6b62dd3169 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.897157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-625f165e-35d7-4ed2-923b-4b6b62dd3169 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.112108 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-625f165e-35d7-4ed2-923b-4b6b62dd3169 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:02.120889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-625f165e-35d7-4ed2-923b-4b6b62dd3169 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.238345 Jun 15 14:44:02.124081 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 109/207] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:01 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:02.582977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e5487778-1195-4a6a-b22f-88ea5b5c9fae tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:02.584150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e5487778-1195-4a6a-b22f-88ea5b5c9fae tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:02.593838 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5487778-1195-4a6a-b22f-88ea5b5c9fae tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.594288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5487778-1195-4a6a-b22f-88ea5b5c9fae tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.595095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5487778-1195-4a6a-b22f-88ea5b5c9fae tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.595685 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5487778-1195-4a6a-b22f-88ea5b5c9fae tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.781634 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:02.783795 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:02.787216 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e5487778-1195-4a6a-b22f-88ea5b5c9fae tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:02.796836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.797995 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.798907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e5487778-1195-4a6a-b22f-88ea5b5c9fae tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.219473 Jun 15 14:44:02.799549 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 99/208] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:02 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:02.800451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.801537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:03.008906 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:03.019537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:03.022060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:03.023422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7b64a82f-32fe-49cb-aacf-7ead17727021 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.249871 Jun 15 14:44:03.024143 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 110/209] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:02 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:03.139304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4dc09e15-e51f-4af4-962f-a8d6ea1d8c91 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:03.140981 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4dc09e15-e51f-4af4-962f-a8d6ea1d8c91 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:03.156929 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4dc09e15-e51f-4af4-962f-a8d6ea1d8c91 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:03.157957 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4dc09e15-e51f-4af4-962f-a8d6ea1d8c91 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:03.159407 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4dc09e15-e51f-4af4-962f-a8d6ea1d8c91 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:03.160818 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4dc09e15-e51f-4af4-962f-a8d6ea1d8c91 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:03.359368 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4dc09e15-e51f-4af4-962f-a8d6ea1d8c91 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:03.374762 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4dc09e15-e51f-4af4-962f-a8d6ea1d8c91 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.238110 Jun 15 14:44:03.378252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 100/210] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:03 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:03.818709 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-bd58250b-db7d-4d6f-9a34-1b3671113b27 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:03.819438 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bd58250b-db7d-4d6f-9a34-1b3671113b27 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:03.827462 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bd58250b-db7d-4d6f-9a34-1b3671113b27 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:03.827914 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bd58250b-db7d-4d6f-9a34-1b3671113b27 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:03.828781 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bd58250b-db7d-4d6f-9a34-1b3671113b27 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:03.829217 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bd58250b-db7d-4d6f-9a34-1b3671113b27 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.015455 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bd58250b-db7d-4d6f-9a34-1b3671113b27 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.032530 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-bd58250b-db7d-4d6f-9a34-1b3671113b27 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.217550 Jun 15 14:44:04.033550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 111/211] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:03 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:04.046187 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:04.048955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:04.058967 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:04.060159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.061713 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:04.062429 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.240050 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.249124 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.250645 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.251840 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d0cb6cd0-4e55-4114-8314-67dedc2975a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.213202 Jun 15 14:44:04.252409 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 101/212] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:04 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:04.394571 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-dd027f06-79d2-47dd-825e-829f928d9db3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:04.396008 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-dd027f06-79d2-47dd-825e-829f928d9db3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:04.412103 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd027f06-79d2-47dd-825e-829f928d9db3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:04.412968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd027f06-79d2-47dd-825e-829f928d9db3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.414133 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd027f06-79d2-47dd-825e-829f928d9db3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:04.414764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd027f06-79d2-47dd-825e-829f928d9db3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.432223 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=100 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:04.590071 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-dd027f06-79d2-47dd-825e-829f928d9db3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.600488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-dd027f06-79d2-47dd-825e-829f928d9db3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.209733 Jun 15 14:44:04.609776 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 112/213] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:04 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:05.058719 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ee3abc89-65fb-4207-bb16-3e706481cd70 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:05.060007 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ee3abc89-65fb-4207-bb16-3e706481cd70 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:05.066379 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee3abc89-65fb-4207-bb16-3e706481cd70 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.066959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee3abc89-65fb-4207-bb16-3e706481cd70 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.069124 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee3abc89-65fb-4207-bb16-3e706481cd70 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.069769 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee3abc89-65fb-4207-bb16-3e706481cd70 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.225049 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ee3abc89-65fb-4207-bb16-3e706481cd70 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:05.240017 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ee3abc89-65fb-4207-bb16-3e706481cd70 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.184772 Jun 15 14:44:05.241277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 102/214] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:05 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:05.271377 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:05.271377 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:05.287821 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.288505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.290231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.290746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.619075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-62fd06c3-9e56-472a-979d-1c9ec2f2613a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:05.620014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-62fd06c3-9e56-472a-979d-1c9ec2f2613a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:05.627641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62fd06c3-9e56-472a-979d-1c9ec2f2613a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.628287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62fd06c3-9e56-472a-979d-1c9ec2f2613a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.629429 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62fd06c3-9e56-472a-979d-1c9ec2f2613a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.630691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62fd06c3-9e56-472a-979d-1c9ec2f2613a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.636364 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:05.646732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:05.648418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:05.649678 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ef390033-d6c1-4681-9590-e0ecfb0e5083 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.383393 Jun 15 14:44:05.650356 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 113/215] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:05 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:05.790944 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-62fd06c3-9e56-472a-979d-1c9ec2f2613a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:05.798367 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-62fd06c3-9e56-472a-979d-1c9ec2f2613a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.184227 Jun 15 14:44:05.798924 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 103/216] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:05 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:06.260770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e2b007c5-ee2e-4a2b-8b85-952595c69a4f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:06.261835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e2b007c5-ee2e-4a2b-8b85-952595c69a4f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:06.277621 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e2b007c5-ee2e-4a2b-8b85-952595c69a4f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.278159 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e2b007c5-ee2e-4a2b-8b85-952595c69a4f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.285921 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e2b007c5-ee2e-4a2b-8b85-952595c69a4f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.286916 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e2b007c5-ee2e-4a2b-8b85-952595c69a4f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.340207 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-75d8408e-eccd-4c1c-9799-d4109a4cecbf req-7d060ff7-1bf7-4878-ae31-61ec0dc116a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992c4ee6-083c-4194-adff-7bf50b93e91c", "name": "network-vif-plugged", "status": "completed", "tag": "949f1732-468d-4323-8ec1-88c3490ca899"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:06.362875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-75d8408e-eccd-4c1c-9799-d4109a4cecbf req-7d060ff7-1bf7-4878-ae31-61ec0dc116a4 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.365963 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-75d8408e-eccd-4c1c-9799-d4109a4cecbf req-7d060ff7-1bf7-4878-ae31-61ec0dc116a4 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.387176 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-75d8408e-eccd-4c1c-9799-d4109a4cecbf req-7d060ff7-1bf7-4878-ae31-61ec0dc116a4 service nova] Creating event network-vif-plugged:949f1732-468d-4323-8ec1-88c3490ca899 for instance 992c4ee6-083c-4194-adff-7bf50b93e91c on hv-cinder-80382 Jun 15 14:44:06.392876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-75d8408e-eccd-4c1c-9799-d4109a4cecbf req-7d060ff7-1bf7-4878-ae31-61ec0dc116a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057409 Jun 15 14:44:06.393882 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 104/217] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:44:06.572250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e2b007c5-ee2e-4a2b-8b85-952595c69a4f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:06.587996 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e2b007c5-ee2e-4a2b-8b85-952595c69a4f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.332951 Jun 15 14:44:06.588947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 114/218] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:06 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:06.669476 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:06.670436 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:06.678548 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.679144 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.680449 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.680949 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.818676 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f6feb3d3-a4ad-4ed6-b72c-50c1750c3450 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:06.819539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f6feb3d3-a4ad-4ed6-b72c-50c1750c3450 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:06.828026 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f6feb3d3-a4ad-4ed6-b72c-50c1750c3450 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.828483 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f6feb3d3-a4ad-4ed6-b72c-50c1750c3450 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.829310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f6feb3d3-a4ad-4ed6-b72c-50c1750c3450 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.829760 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f6feb3d3-a4ad-4ed6-b72c-50c1750c3450 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.875165 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:06.897665 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:06.901377 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:06.903039 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cf79c8aa-0bde-4639-b98e-ef3ed80339c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.237790 Jun 15 14:44:06.903941 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 105/219] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:06 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:07.001784 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f6feb3d3-a4ad-4ed6-b72c-50c1750c3450 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:07.009747 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f6feb3d3-a4ad-4ed6-b72c-50c1750c3450 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.196805 Jun 15 14:44:07.010319 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 115/220] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:06 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:07.607020 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6782a9a0-7769-4c92-8a2d-a131c17090da tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:07.607698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6782a9a0-7769-4c92-8a2d-a131c17090da tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:07.618283 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6782a9a0-7769-4c92-8a2d-a131c17090da tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.621858 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6782a9a0-7769-4c92-8a2d-a131c17090da tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:07.624881 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6782a9a0-7769-4c92-8a2d-a131c17090da tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.626932 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6782a9a0-7769-4c92-8a2d-a131c17090da tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:07.641501 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:07.857837 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6782a9a0-7769-4c92-8a2d-a131c17090da tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:07.867291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6782a9a0-7769-4c92-8a2d-a131c17090da tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.264959 Jun 15 14:44:07.868783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 106/221] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:07 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:07.926168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:07.927498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:07.940932 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.945775 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:07.947093 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.947819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:08.027883 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-33b49ccb-7e19-4183-8c32-fa7131f508d4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:08.029031 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-33b49ccb-7e19-4183-8c32-fa7131f508d4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:08.040697 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33b49ccb-7e19-4183-8c32-fa7131f508d4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:08.041924 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33b49ccb-7e19-4183-8c32-fa7131f508d4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:08.043353 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33b49ccb-7e19-4183-8c32-fa7131f508d4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:08.044081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33b49ccb-7e19-4183-8c32-fa7131f508d4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:08.122853 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:08.136116 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:08.137694 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:08.140290 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-157f2858-28b9-49ea-928b-6d977679d519 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.222678 Jun 15 14:44:08.156898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 116/222] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:07 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:08.257856 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-33b49ccb-7e19-4183-8c32-fa7131f508d4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:08.267069 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-33b49ccb-7e19-4183-8c32-fa7131f508d4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.244277 Jun 15 14:44:08.271472 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 107/223] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:08 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:08.885895 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d4e0af93-5ef8-4c6f-b464-efaad3bb3610 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:08.886684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d4e0af93-5ef8-4c6f-b464-efaad3bb3610 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:08.897003 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d4e0af93-5ef8-4c6f-b464-efaad3bb3610 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:08.897466 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d4e0af93-5ef8-4c6f-b464-efaad3bb3610 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:08.898356 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d4e0af93-5ef8-4c6f-b464-efaad3bb3610 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:08.898799 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d4e0af93-5ef8-4c6f-b464-efaad3bb3610 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.122221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d4e0af93-5ef8-4c6f-b464-efaad3bb3610 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:09.134197 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d4e0af93-5ef8-4c6f-b464-efaad3bb3610 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.248767 Jun 15 14:44:09.139563 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 117/224] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:08 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:09.163238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:09.164634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:09.175222 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.175664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.176918 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.177649 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.299245 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2fc01b15-ad7f-4037-9655-3b005c9d1c6b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:09.299245 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2fc01b15-ad7f-4037-9655-3b005c9d1c6b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:09.313014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2fc01b15-ad7f-4037-9655-3b005c9d1c6b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.313798 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2fc01b15-ad7f-4037-9655-3b005c9d1c6b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.315045 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2fc01b15-ad7f-4037-9655-3b005c9d1c6b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.315641 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2fc01b15-ad7f-4037-9655-3b005c9d1c6b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.368445 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:09.391342 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:09.393693 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:09.395018 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-619eb3ed-b833-4200-890d-681b3e64a14b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.237275 Jun 15 14:44:09.396560 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 108/225] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:09 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:09.493265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2fc01b15-ad7f-4037-9655-3b005c9d1c6b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:09.500756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2fc01b15-ad7f-4037-9655-3b005c9d1c6b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1320 microversion: 2.1 time: 0.218773 Jun 15 14:44:09.501752 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 118/226] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:09 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:10.148620 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a87d06a0-4bb9-4720-8b20-cbf92641510a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:10.149241 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a87d06a0-4bb9-4720-8b20-cbf92641510a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:10.160544 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a87d06a0-4bb9-4720-8b20-cbf92641510a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.161148 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a87d06a0-4bb9-4720-8b20-cbf92641510a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.166262 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a87d06a0-4bb9-4720-8b20-cbf92641510a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.166833 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a87d06a0-4bb9-4720-8b20-cbf92641510a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.365351 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a87d06a0-4bb9-4720-8b20-cbf92641510a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:10.376786 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a87d06a0-4bb9-4720-8b20-cbf92641510a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.233577 Jun 15 14:44:10.378021 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 109/227] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:10 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:10.414525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:10.415155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:10.425763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.426364 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.428067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.429130 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.518263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-31d5e5c7-14b2-4c5d-9dc4-eabb6b3641bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:10.518884 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-31d5e5c7-14b2-4c5d-9dc4-eabb6b3641bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:10.531465 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31d5e5c7-14b2-4c5d-9dc4-eabb6b3641bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.534173 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31d5e5c7-14b2-4c5d-9dc4-eabb6b3641bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.535014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31d5e5c7-14b2-4c5d-9dc4-eabb6b3641bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.538921 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31d5e5c7-14b2-4c5d-9dc4-eabb6b3641bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.734229 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:10.742807 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:10.744354 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:10.745704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-91c2f972-bab1-4810-bfdf-b081f054967f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.336014 Jun 15 14:44:10.746267 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 119/228] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:10 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:44:10.764156 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-31d5e5c7-14b2-4c5d-9dc4-eabb6b3641bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:10.772289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-31d5e5c7-14b2-4c5d-9dc4-eabb6b3641bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1515 microversion: 2.1 time: 0.258939 Jun 15 14:44:10.772910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 110/229] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:10 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1515 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:10.795706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a44d5457-e165-462d-b99f-d871c60e62fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:10.798293 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a44d5457-e165-462d-b99f-d871c60e62fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:10.807293 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a44d5457-e165-462d-b99f-d871c60e62fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.808861 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a44d5457-e165-462d-b99f-d871c60e62fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.810531 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a44d5457-e165-462d-b99f-d871c60e62fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.811410 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a44d5457-e165-462d-b99f-d871c60e62fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.886523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-a44d5457-e165-462d-b99f-d871c60e62fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lazy-loading 'flavor' on Instance uuid 1d16976b-b746-452b-b48d-b7a26950a19e {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:44:11.015214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a44d5457-e165-462d-b99f-d871c60e62fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e/action" status: 200 len: 32 microversion: 2.1 time: 0.228912 Jun 15 14:44:11.015764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 120/230] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:44:10 2022] POST /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:44:11.025265 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-78c1d1d5-9d37-4952-b6f0-df08dd0a659a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:11.025893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-78c1d1d5-9d37-4952-b6f0-df08dd0a659a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:11.032085 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-78c1d1d5-9d37-4952-b6f0-df08dd0a659a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:11.032527 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-78c1d1d5-9d37-4952-b6f0-df08dd0a659a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.033337 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-78c1d1d5-9d37-4952-b6f0-df08dd0a659a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:11.033753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-78c1d1d5-9d37-4952-b6f0-df08dd0a659a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.178365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-78c1d1d5-9d37-4952-b6f0-df08dd0a659a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:11.186451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-78c1d1d5-9d37-4952-b6f0-df08dd0a659a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.164936 Jun 15 14:44:11.187081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 111/231] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:11 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:11.393905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5202ffe1-c185-48e7-a90e-c2921d5825ea tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:11.394827 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5202ffe1-c185-48e7-a90e-c2921d5825ea tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:11.401905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5202ffe1-c185-48e7-a90e-c2921d5825ea tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:11.402354 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5202ffe1-c185-48e7-a90e-c2921d5825ea tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.403304 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5202ffe1-c185-48e7-a90e-c2921d5825ea tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:11.403741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5202ffe1-c185-48e7-a90e-c2921d5825ea tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.549576 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5202ffe1-c185-48e7-a90e-c2921d5825ea tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:11.557953 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5202ffe1-c185-48e7-a90e-c2921d5825ea tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.168037 Jun 15 14:44:11.558482 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 121/232] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:11 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:11.763735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:11.764343 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:11.771151 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:11.771610 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.772382 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:11.773028 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.936770 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:11.944732 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:11.947133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:11.948234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4b61a3f7-2d47-44de-aa6e-5efd32883ac5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.188548 Jun 15 14:44:11.948782 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 112/233] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:11 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:12.204801 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0d472e43-eddd-4bca-8534-5dc8413b1c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:12.205406 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0d472e43-eddd-4bca-8534-5dc8413b1c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:12.207401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=100 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:12.213286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0d472e43-eddd-4bca-8534-5dc8413b1c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.213735 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0d472e43-eddd-4bca-8534-5dc8413b1c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:12.214495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0d472e43-eddd-4bca-8534-5dc8413b1c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.214934 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0d472e43-eddd-4bca-8534-5dc8413b1c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:12.346335 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0d472e43-eddd-4bca-8534-5dc8413b1c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:12.362006 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0d472e43-eddd-4bca-8534-5dc8413b1c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.161808 Jun 15 14:44:12.362587 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 122/234] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:12 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:12.573954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-73e1759d-4042-40a6-a914-412ff670a5c5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:12.574715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-73e1759d-4042-40a6-a914-412ff670a5c5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:12.581101 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-73e1759d-4042-40a6-a914-412ff670a5c5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.581659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-73e1759d-4042-40a6-a914-412ff670a5c5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:12.582310 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-73e1759d-4042-40a6-a914-412ff670a5c5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.582744 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-73e1759d-4042-40a6-a914-412ff670a5c5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:12.728565 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-73e1759d-4042-40a6-a914-412ff670a5c5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:12.736015 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-73e1759d-4042-40a6-a914-412ff670a5c5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.165865 Jun 15 14:44:12.736577 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 113/235] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:12 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:12.966575 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:12.967317 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:12.974917 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.975408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:12.976386 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.976913 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.160922 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.170452 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.172253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.174183 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-362103b5-d779-4341-81f5-abb1ec77c0f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.211702 Jun 15 14:44:13.174864 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 123/236] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:12 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:13.379750 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-15395a2f-9a15-4afb-803a-1445d728f94d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:13.380356 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-15395a2f-9a15-4afb-803a-1445d728f94d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:13.386313 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-15395a2f-9a15-4afb-803a-1445d728f94d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.386700 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-15395a2f-9a15-4afb-803a-1445d728f94d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.387499 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-15395a2f-9a15-4afb-803a-1445d728f94d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.387935 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-15395a2f-9a15-4afb-803a-1445d728f94d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.515260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-15395a2f-9a15-4afb-803a-1445d728f94d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.523133 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-15395a2f-9a15-4afb-803a-1445d728f94d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.147222 Jun 15 14:44:13.523694 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 114/237] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:13 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:13.753947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9bf2bec3-42a5-46ab-82f4-f6305e8f0c79 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:13.754558 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9bf2bec3-42a5-46ab-82f4-f6305e8f0c79 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:13.760674 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bf2bec3-42a5-46ab-82f4-f6305e8f0c79 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.761151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bf2bec3-42a5-46ab-82f4-f6305e8f0c79 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.761908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bf2bec3-42a5-46ab-82f4-f6305e8f0c79 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.762342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bf2bec3-42a5-46ab-82f4-f6305e8f0c79 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.887684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9bf2bec3-42a5-46ab-82f4-f6305e8f0c79 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.895929 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9bf2bec3-42a5-46ab-82f4-f6305e8f0c79 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.145456 Jun 15 14:44:13.896824 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 124/238] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:13 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:14.200435 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:14.201148 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:14.207611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:14.208078 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:14.208825 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:14.209250 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:14.340005 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:14.347755 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:14.349945 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:14.351048 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e35d351e-192f-466d-9a68-870028013552 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.154453 Jun 15 14:44:14.351618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 115/239] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:14 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:14.540091 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-71d182b2-3b10-4b9d-a286-87c3f50357cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:14.540717 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-71d182b2-3b10-4b9d-a286-87c3f50357cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:14.546723 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-71d182b2-3b10-4b9d-a286-87c3f50357cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:14.547205 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-71d182b2-3b10-4b9d-a286-87c3f50357cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:14.547981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-71d182b2-3b10-4b9d-a286-87c3f50357cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:14.548411 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-71d182b2-3b10-4b9d-a286-87c3f50357cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:14.674485 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-71d182b2-3b10-4b9d-a286-87c3f50357cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:14.682086 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-71d182b2-3b10-4b9d-a286-87c3f50357cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.145830 Jun 15 14:44:14.682656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 125/240] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:14 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:14.912785 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1fdec715-8044-4c58-855e-9f75f17d0441 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:14.913421 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1fdec715-8044-4c58-855e-9f75f17d0441 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:14.919434 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fdec715-8044-4c58-855e-9f75f17d0441 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:14.919880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fdec715-8044-4c58-855e-9f75f17d0441 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:14.920644 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fdec715-8044-4c58-855e-9f75f17d0441 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:14.921076 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fdec715-8044-4c58-855e-9f75f17d0441 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:15.050286 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1fdec715-8044-4c58-855e-9f75f17d0441 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:15.058399 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1fdec715-8044-4c58-855e-9f75f17d0441 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.149478 Jun 15 14:44:15.059019 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 116/241] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:14 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:15.369879 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:15.370475 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:15.376581 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:15.377027 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:15.377769 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:15.378198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:15.515703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:15.524135 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:15.525708 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:15.527062 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-61bab4e4-e6a3-4d3d-91b8-46d3239c24fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.160898 Jun 15 14:44:15.527850 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 126/242] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:15 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:15.698787 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4f926c36-13f0-4a27-ac79-149fce7e5b1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:15.699433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4f926c36-13f0-4a27-ac79-149fce7e5b1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:15.702741 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=74 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:15.706550 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4f926c36-13f0-4a27-ac79-149fce7e5b1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:15.707023 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4f926c36-13f0-4a27-ac79-149fce7e5b1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:15.707805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4f926c36-13f0-4a27-ac79-149fce7e5b1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:15.708237 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4f926c36-13f0-4a27-ac79-149fce7e5b1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:15.881742 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4f926c36-13f0-4a27-ac79-149fce7e5b1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:15.890867 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4f926c36-13f0-4a27-ac79-149fce7e5b1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.195846 Jun 15 14:44:15.891471 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 117/243] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:15 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:16.076368 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8c86eae5-7046-4f51-810a-217bac855c04 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.077074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8c86eae5-7046-4f51-810a-217bac855c04 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:16.083582 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8c86eae5-7046-4f51-810a-217bac855c04 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.084035 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8c86eae5-7046-4f51-810a-217bac855c04 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.084789 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8c86eae5-7046-4f51-810a-217bac855c04 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.085220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8c86eae5-7046-4f51-810a-217bac855c04 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.089119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:16.440025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8c86eae5-7046-4f51-810a-217bac855c04 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:16.448266 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8c86eae5-7046-4f51-810a-217bac855c04 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1362 microversion: 2.1 time: 0.375978 Jun 15 14:44:16.448757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 127/244] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:16.546691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.547489 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:16.553724 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.554645 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.555562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.556058 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.658922 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-85296146-5e77-451c-bd1f-ab4088798fe8 req-efec2a9c-fa7c-444c-9a49-094af96aad06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75215a3c-bc0f-4e8b-9c52-a35946a5bfb1", "name": "network-vif-plugged", "status": "completed", "tag": "e62eb4f5-3c82-41c8-bbba-4140a119e597"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:16.668351 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-85296146-5e77-451c-bd1f-ab4088798fe8 req-efec2a9c-fa7c-444c-9a49-094af96aad06 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.668860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-85296146-5e77-451c-bd1f-ab4088798fe8 req-efec2a9c-fa7c-444c-9a49-094af96aad06 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.681775 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-85296146-5e77-451c-bd1f-ab4088798fe8 req-efec2a9c-fa7c-444c-9a49-094af96aad06 service nova] Creating event network-vif-plugged:e62eb4f5-3c82-41c8-bbba-4140a119e597 for instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 on hv-cinder-80382 Jun 15 14:44:16.687258 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-85296146-5e77-451c-bd1f-ab4088798fe8 req-efec2a9c-fa7c-444c-9a49-094af96aad06 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031924 Jun 15 14:44:16.688321 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 128/245] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:16.735813 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:16.744483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:16.745997 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:16.747124 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d7ea5574-9bbd-44ea-8e29-0ebeef78aadb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.204881 Jun 15 14:44:16.747684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 118/246] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:16.932933 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f2bea25e-ac4a-4cf0-93bf-898e851fb97b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.933917 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f2bea25e-ac4a-4cf0-93bf-898e851fb97b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:16.942212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2bea25e-ac4a-4cf0-93bf-898e851fb97b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.943441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2bea25e-ac4a-4cf0-93bf-898e851fb97b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.946008 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2bea25e-ac4a-4cf0-93bf-898e851fb97b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.946635 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2bea25e-ac4a-4cf0-93bf-898e851fb97b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:17.157912 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f2bea25e-ac4a-4cf0-93bf-898e851fb97b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:17.165748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f2bea25e-ac4a-4cf0-93bf-898e851fb97b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.252122 Jun 15 14:44:17.166164 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 129/247] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:17.464783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3ef19938-57fa-4352-b448-9b03475a0913 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:17.465392 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3ef19938-57fa-4352-b448-9b03475a0913 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:17.471283 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ef19938-57fa-4352-b448-9b03475a0913 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:17.471730 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ef19938-57fa-4352-b448-9b03475a0913 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:17.472494 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ef19938-57fa-4352-b448-9b03475a0913 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:17.472959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ef19938-57fa-4352-b448-9b03475a0913 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:17.633934 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3ef19938-57fa-4352-b448-9b03475a0913 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:17.649385 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3ef19938-57fa-4352-b448-9b03475a0913 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1548 microversion: 2.1 time: 0.188349 Jun 15 14:44:17.649978 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 119/248] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:17 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:17.668601 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ae8360b6-d342-4e39-bb98-32d904d9d548 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:17.669083 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ae8360b6-d342-4e39-bb98-32d904d9d548 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:17.675111 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae8360b6-d342-4e39-bb98-32d904d9d548 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:17.675558 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae8360b6-d342-4e39-bb98-32d904d9d548 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:17.677261 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae8360b6-d342-4e39-bb98-32d904d9d548 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:17.677710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae8360b6-d342-4e39-bb98-32d904d9d548 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:17.757097 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ae8360b6-d342-4e39-bb98-32d904d9d548 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093123 Jun 15 14:44:17.757711 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 130/249] 10.222.0.45 () {58 vars in 1274 bytes} [Wed Jun 15 14:44:17 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:17.765824 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:17.766437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:17.773485 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:17.773931 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:17.774756 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:17.775220 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:18.104672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:18.112586 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:18.115210 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:18.116714 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-19f38ebd-4e7e-41bd-bcef-2496116178e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.354578 Jun 15 14:44:18.117057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 120/250] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:17 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:18.186053 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a4e00498-661a-4339-a968-01e4d60ac904 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:18.186638 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a4e00498-661a-4339-a968-01e4d60ac904 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:18.195141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4e00498-661a-4339-a968-01e4d60ac904 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:18.196148 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4e00498-661a-4339-a968-01e4d60ac904 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:18.197004 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4e00498-661a-4339-a968-01e4d60ac904 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:18.197529 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4e00498-661a-4339-a968-01e4d60ac904 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:18.715022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a4e00498-661a-4339-a968-01e4d60ac904 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:18.732944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a4e00498-661a-4339-a968-01e4d60ac904 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.551501 Jun 15 14:44:18.733613 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 131/251] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:18 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:19.134312 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:19.135076 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:19.141371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:19.141812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:19.142564 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:19.143006 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:19.329066 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-84f0d9f8-ec15-4eec-aba7-add853429642 req-86c95ac2-dfe1-430d-909d-5ef929a188b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "992c4ee6-083c-4194-adff-7bf50b93e91c", "tag": "949f1732-468d-4323-8ec1-88c3490ca899"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:19.329847 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:19.338669 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-84f0d9f8-ec15-4eec-aba7-add853429642 req-86c95ac2-dfe1-430d-909d-5ef929a188b4 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:19.338844 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:19.339162 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-84f0d9f8-ec15-4eec-aba7-add853429642 req-86c95ac2-dfe1-430d-909d-5ef929a188b4 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:19.340394 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:19.341495 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e8d5ee18-8913-4c7a-87d4-b65f2e60a678 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.211085 Jun 15 14:44:19.342252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 121/252] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:19 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:19.351627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-84f0d9f8-ec15-4eec-aba7-add853429642 req-86c95ac2-dfe1-430d-909d-5ef929a188b4 service nova] Creating event network-changed:949f1732-468d-4323-8ec1-88c3490ca899 for instance 992c4ee6-083c-4194-adff-7bf50b93e91c on hv-cinder-80382 Jun 15 14:44:19.357679 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-84f0d9f8-ec15-4eec-aba7-add853429642 req-86c95ac2-dfe1-430d-909d-5ef929a188b4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033224 Jun 15 14:44:19.358427 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 132/253] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:19.749460 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-540722a6-8204-49d7-8f13-8092407e6790 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:19.751187 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-540722a6-8204-49d7-8f13-8092407e6790 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:19.760675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-540722a6-8204-49d7-8f13-8092407e6790 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:19.761445 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-540722a6-8204-49d7-8f13-8092407e6790 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:19.762386 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-540722a6-8204-49d7-8f13-8092407e6790 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:19.762978 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-540722a6-8204-49d7-8f13-8092407e6790 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:19.934179 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-540722a6-8204-49d7-8f13-8092407e6790 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:19.936434 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:19.943503 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-540722a6-8204-49d7-8f13-8092407e6790 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.197740 Jun 15 14:44:19.944078 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 122/254] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:19 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:20.360940 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:20.361645 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:20.368973 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:20.369420 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:20.370185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:20.370615 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:20.541181 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:20.549606 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:20.551578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:20.552811 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a5cce037-38d3-415b-b877-c24d025df71e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.196496 Jun 15 14:44:20.553465 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 133/255] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:20 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:44:20.961145 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1c8fbc60-8c20-49bf-a390-3fde1d969480 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:20.961751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1c8fbc60-8c20-49bf-a390-3fde1d969480 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:20.968629 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1c8fbc60-8c20-49bf-a390-3fde1d969480 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:20.969076 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1c8fbc60-8c20-49bf-a390-3fde1d969480 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:20.969847 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1c8fbc60-8c20-49bf-a390-3fde1d969480 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:20.970289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1c8fbc60-8c20-49bf-a390-3fde1d969480 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:21.106667 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1c8fbc60-8c20-49bf-a390-3fde1d969480 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:21.115052 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1c8fbc60-8c20-49bf-a390-3fde1d969480 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.157646 Jun 15 14:44:21.115735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 123/256] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:20 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:21.572118 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:21.572799 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:21.578771 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:21.579422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:21.580200 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:21.580637 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:21.715127 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:21.723170 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:21.724692 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:21.725803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e1160315-c851-4647-84de-eab93af65ac6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.158714 Jun 15 14:44:21.726374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 134/257] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:21 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:22.133740 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ee1d8bcd-4b0f-46b6-84cd-adbba964d11c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:22.134298 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ee1d8bcd-4b0f-46b6-84cd-adbba964d11c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:22.140767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee1d8bcd-4b0f-46b6-84cd-adbba964d11c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:22.141210 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee1d8bcd-4b0f-46b6-84cd-adbba964d11c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:22.141966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee1d8bcd-4b0f-46b6-84cd-adbba964d11c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:22.142399 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee1d8bcd-4b0f-46b6-84cd-adbba964d11c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:22.272205 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ee1d8bcd-4b0f-46b6-84cd-adbba964d11c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:22.279845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ee1d8bcd-4b0f-46b6-84cd-adbba964d11c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.150746 Jun 15 14:44:22.280447 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 124/258] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:22 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:22.745334 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:22.745935 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:22.752835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:22.753369 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:22.754292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:22.755383 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:22.889592 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:22.897456 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:22.898973 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:22.900093 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b2758357-ff9a-4c97-b11d-dfd7e7dac891 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.159912 Jun 15 14:44:22.900649 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 135/259] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:22 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:23.296946 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4169c999-a580-4a33-a9d1-885e75644865 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:23.297554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4169c999-a580-4a33-a9d1-885e75644865 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:23.304650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4169c999-a580-4a33-a9d1-885e75644865 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:23.305092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4169c999-a580-4a33-a9d1-885e75644865 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:23.306071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4169c999-a580-4a33-a9d1-885e75644865 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:23.306501 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4169c999-a580-4a33-a9d1-885e75644865 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:23.437705 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4169c999-a580-4a33-a9d1-885e75644865 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:23.445295 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4169c999-a580-4a33-a9d1-885e75644865 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.152174 Jun 15 14:44:23.445857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 125/260] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:23 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:23.920247 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:23.920818 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:23.926889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:23.927370 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:23.928166 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:23.928601 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:24.059436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:24.067648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:24.069151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:24.070263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d8406085-29c6-4972-93a6-9e1baef6830c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.154746 Jun 15 14:44:24.071631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 136/261] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:23 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:24.462402 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-db430a02-1afc-4619-bb34-f63e827266fe tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:24.463067 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-db430a02-1afc-4619-bb34-f63e827266fe tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:24.469565 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db430a02-1afc-4619-bb34-f63e827266fe tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:24.470017 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db430a02-1afc-4619-bb34-f63e827266fe tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:24.470781 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db430a02-1afc-4619-bb34-f63e827266fe tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:24.471246 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db430a02-1afc-4619-bb34-f63e827266fe tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:24.608649 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-db430a02-1afc-4619-bb34-f63e827266fe tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:24.616231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-db430a02-1afc-4619-bb34-f63e827266fe tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.158394 Jun 15 14:44:24.616785 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 126/262] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:24 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:25.091561 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:25.092171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:25.098325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:25.099334 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:25.100192 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:25.100825 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:25.233486 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:25.242202 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:25.243754 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:25.244939 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-579a750c-169c-4e6c-9e04-becb03b84a37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.159555 Jun 15 14:44:25.245506 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 137/263] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:25 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:25.633732 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d17eca1c-6409-47f2-b501-c37afa629509 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:25.634344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d17eca1c-6409-47f2-b501-c37afa629509 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:25.641169 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d17eca1c-6409-47f2-b501-c37afa629509 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:25.641618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d17eca1c-6409-47f2-b501-c37afa629509 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:25.642391 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d17eca1c-6409-47f2-b501-c37afa629509 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:25.642827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d17eca1c-6409-47f2-b501-c37afa629509 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:25.787908 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d17eca1c-6409-47f2-b501-c37afa629509 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:25.796044 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d17eca1c-6409-47f2-b501-c37afa629509 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.166858 Jun 15 14:44:25.796626 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 127/264] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:25 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:26.263272 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:26.264733 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:26.271363 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:26.271803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:26.272599 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:26.273020 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:26.419283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:26.427835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:26.429338 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:26.430430 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-994d7e27-36e5-4968-9108-347bcfa193d7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.171364 Jun 15 14:44:26.430981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 138/265] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:26 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:44:26.812823 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-66e82b55-f64c-48a5-8799-6a49b4aaac38 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:26.813487 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-66e82b55-f64c-48a5-8799-6a49b4aaac38 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:26.820517 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-66e82b55-f64c-48a5-8799-6a49b4aaac38 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:26.820969 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-66e82b55-f64c-48a5-8799-6a49b4aaac38 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:26.821726 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-66e82b55-f64c-48a5-8799-6a49b4aaac38 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:26.822157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-66e82b55-f64c-48a5-8799-6a49b4aaac38 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:26.956417 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-66e82b55-f64c-48a5-8799-6a49b4aaac38 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:26.965008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-66e82b55-f64c-48a5-8799-6a49b4aaac38 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.156085 Jun 15 14:44:26.965600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 128/266] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:26 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:27.449046 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:27.449660 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:27.456402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:27.456886 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:27.458355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:27.458810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:27.597116 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:27.605836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:27.607370 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:27.608552 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f84f4605-8d99-464f-ba5f-0432cb3a4903 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.163547 Jun 15 14:44:27.609223 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 139/267] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:27 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:44:27.982341 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8ebdc7ac-c7c4-46ab-84fb-7d51e720c1b7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:27.982940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8ebdc7ac-c7c4-46ab-84fb-7d51e720c1b7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:27.990626 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ebdc7ac-c7c4-46ab-84fb-7d51e720c1b7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:27.991229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ebdc7ac-c7c4-46ab-84fb-7d51e720c1b7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:27.992131 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ebdc7ac-c7c4-46ab-84fb-7d51e720c1b7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:27.992619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ebdc7ac-c7c4-46ab-84fb-7d51e720c1b7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:28.130695 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8ebdc7ac-c7c4-46ab-84fb-7d51e720c1b7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:28.138077 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8ebdc7ac-c7c4-46ab-84fb-7d51e720c1b7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.159613 Jun 15 14:44:28.138649 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 129/268] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:27 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:28.627388 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:28.628018 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:28.634869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:28.635275 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:28.636042 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:28.636470 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:28.766318 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:28.774258 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:28.775801 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:28.776911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2aae0479-1977-48ad-88c9-1ab7c8d6fb30 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.153417 Jun 15 14:44:28.777735 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 140/269] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:28 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:29.155713 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9f37ce05-8d7b-4e1e-820e-5f3bafcc69c9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:29.156245 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9f37ce05-8d7b-4e1e-820e-5f3bafcc69c9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:29.162817 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f37ce05-8d7b-4e1e-820e-5f3bafcc69c9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:29.163284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f37ce05-8d7b-4e1e-820e-5f3bafcc69c9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:29.164651 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f37ce05-8d7b-4e1e-820e-5f3bafcc69c9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:29.165084 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f37ce05-8d7b-4e1e-820e-5f3bafcc69c9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:29.504980 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9f37ce05-8d7b-4e1e-820e-5f3bafcc69c9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:29.512381 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9f37ce05-8d7b-4e1e-820e-5f3bafcc69c9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.360821 Jun 15 14:44:29.512946 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 130/270] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:29 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:29.795752 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:29.796612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:29.802956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:29.803433 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:29.804206 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:29.804644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:29.937150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:29.947049 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:29.948742 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:29.949882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6cddb7c4-aaf3-4d20-8efd-138f411578bc tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.158250 Jun 15 14:44:29.950691 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 141/271] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:29 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:30.530236 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-56ba29ec-06c8-4d2d-8137-1f91e32f31c1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:30.530843 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-56ba29ec-06c8-4d2d-8137-1f91e32f31c1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:30.538280 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56ba29ec-06c8-4d2d-8137-1f91e32f31c1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.538820 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56ba29ec-06c8-4d2d-8137-1f91e32f31c1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:30.539627 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56ba29ec-06c8-4d2d-8137-1f91e32f31c1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.540055 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56ba29ec-06c8-4d2d-8137-1f91e32f31c1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:30.684752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-56ba29ec-06c8-4d2d-8137-1f91e32f31c1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:30.693518 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-56ba29ec-06c8-4d2d-8137-1f91e32f31c1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.166879 Jun 15 14:44:30.694116 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 131/272] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:30 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:30.967814 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:30.968421 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:30.975112 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.975558 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:30.976350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.976785 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:31.137492 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:31.146036 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:31.147804 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:31.148686 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a5030bb9-0a7f-44da-bbdc-4195d46a1d23 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.184802 Jun 15 14:44:31.149239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 142/273] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:30 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:31.710745 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0f03e69a-1129-4a48-821c-83c122326de9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:31.711365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0f03e69a-1129-4a48-821c-83c122326de9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:31.717924 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0f03e69a-1129-4a48-821c-83c122326de9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:31.718363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0f03e69a-1129-4a48-821c-83c122326de9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:31.719156 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0f03e69a-1129-4a48-821c-83c122326de9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:31.719590 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0f03e69a-1129-4a48-821c-83c122326de9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:31.852529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0f03e69a-1129-4a48-821c-83c122326de9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:31.860216 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0f03e69a-1129-4a48-821c-83c122326de9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.153902 Jun 15 14:44:31.860785 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 132/274] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:31 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:32.168519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:32.169170 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:32.175810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.176267 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:32.178250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.178700 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:32.314767 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:32.324923 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:32.326570 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:32.328457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d377697c-c61b-4ec8-9d9a-71ed43234940 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.163773 Jun 15 14:44:32.329507 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 143/275] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:32 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:32.877329 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b4b19812-242f-4ba5-9e42-7dd0cb1b4ef1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:32.877932 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b4b19812-242f-4ba5-9e42-7dd0cb1b4ef1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:32.884375 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4b19812-242f-4ba5-9e42-7dd0cb1b4ef1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.884817 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4b19812-242f-4ba5-9e42-7dd0cb1b4ef1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:32.885561 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4b19812-242f-4ba5-9e42-7dd0cb1b4ef1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.885989 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4b19812-242f-4ba5-9e42-7dd0cb1b4ef1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:33.016955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b4b19812-242f-4ba5-9e42-7dd0cb1b4ef1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:33.025889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b4b19812-242f-4ba5-9e42-7dd0cb1b4ef1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.152863 Jun 15 14:44:33.026480 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 133/276] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:32 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:33.351878 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:33.352513 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:33.358499 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:33.358944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:33.359756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:33.360181 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:33.501364 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:33.510249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:33.511783 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:33.512873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-97b33b9a-72c4-48e6-acc2-654ea0b2ecb6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.165241 Jun 15 14:44:33.513430 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 144/277] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:33 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:44:34.043781 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6f4a30fa-17d4-4ab5-a88b-b7e07d096fb4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:34.044402 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6f4a30fa-17d4-4ab5-a88b-b7e07d096fb4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:34.051016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f4a30fa-17d4-4ab5-a88b-b7e07d096fb4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:34.051459 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f4a30fa-17d4-4ab5-a88b-b7e07d096fb4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:34.052257 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f4a30fa-17d4-4ab5-a88b-b7e07d096fb4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:34.053214 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f4a30fa-17d4-4ab5-a88b-b7e07d096fb4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:34.184979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6f4a30fa-17d4-4ab5-a88b-b7e07d096fb4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:34.192489 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6f4a30fa-17d4-4ab5-a88b-b7e07d096fb4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.152497 Jun 15 14:44:34.193779 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 134/278] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:34 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:34.531391 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:34.531994 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:34.538593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:34.539263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:34.539791 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:34.540218 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:34.555342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=100 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:34.671621 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:34.681981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:34.683515 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:34.684614 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6a3c4160-fbae-4663-a01d-24b11f0eec0e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1406 microversion: 2.20 time: 0.157373 Jun 15 14:44:34.685221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 145/279] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:34 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:35.210367 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ea33cdc5-2b6e-44c1-a8b5-372289260fae tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:35.210904 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ea33cdc5-2b6e-44c1-a8b5-372289260fae tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:35.217685 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ea33cdc5-2b6e-44c1-a8b5-372289260fae tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:35.218208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ea33cdc5-2b6e-44c1-a8b5-372289260fae tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:35.219659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ea33cdc5-2b6e-44c1-a8b5-372289260fae tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:35.220217 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ea33cdc5-2b6e-44c1-a8b5-372289260fae tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:35.427910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ea33cdc5-2b6e-44c1-a8b5-372289260fae tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:35.438319 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ea33cdc5-2b6e-44c1-a8b5-372289260fae tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.232236 Jun 15 14:44:35.440426 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 135/280] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:35 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:35.703980 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:35.705520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:35.712971 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:35.713775 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:35.714844 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:35.715439 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:35.860306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:35.869319 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:35.871094 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:35.872268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-81144897-6de9-42e5-a9be-53b474f24d44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1597 microversion: 2.20 time: 0.173247 Jun 15 14:44:35.872827 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 146/281] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:35 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1597 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:35.891414 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-32e9f05c-cd97-4172-9e48-ceeb9f1b1179 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:35.892150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-32e9f05c-cd97-4172-9e48-ceeb9f1b1179 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:35.898523 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-32e9f05c-cd97-4172-9e48-ceeb9f1b1179 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:35.899108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-32e9f05c-cd97-4172-9e48-ceeb9f1b1179 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:35.900112 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-32e9f05c-cd97-4172-9e48-ceeb9f1b1179 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:35.900611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-32e9f05c-cd97-4172-9e48-ceeb9f1b1179 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:36.000790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-32e9f05c-cd97-4172-9e48-ceeb9f1b1179 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.113313 Jun 15 14:44:36.001402 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 136/282] 10.222.0.45 () {60 vars in 1315 bytes} [Wed Jun 15 14:44:35 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:44:36.456245 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-17e1e43b-01d8-4160-88f6-9736d06e5678 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:36.456867 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-17e1e43b-01d8-4160-88f6-9736d06e5678 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:36.464117 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-17e1e43b-01d8-4160-88f6-9736d06e5678 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:36.464580 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-17e1e43b-01d8-4160-88f6-9736d06e5678 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:36.465382 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-17e1e43b-01d8-4160-88f6-9736d06e5678 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:36.465836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-17e1e43b-01d8-4160-88f6-9736d06e5678 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:36.746345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-17e1e43b-01d8-4160-88f6-9736d06e5678 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:36.754676 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-17e1e43b-01d8-4160-88f6-9736d06e5678 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.302474 Jun 15 14:44:36.755377 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 147/283] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:36 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:37.190757 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-173deda4-e95e-420d-89a4-4e19a8e7fbbc req-98207ecc-d44a-4a92-bd44-92c82ad50b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75215a3c-bc0f-4e8b-9c52-a35946a5bfb1", "tag": "e62eb4f5-3c82-41c8-bbba-4140a119e597"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:37.205248 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-173deda4-e95e-420d-89a4-4e19a8e7fbbc req-98207ecc-d44a-4a92-bd44-92c82ad50b7a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:37.206329 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-173deda4-e95e-420d-89a4-4e19a8e7fbbc req-98207ecc-d44a-4a92-bd44-92c82ad50b7a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:37.219158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-173deda4-e95e-420d-89a4-4e19a8e7fbbc req-98207ecc-d44a-4a92-bd44-92c82ad50b7a service nova] Creating event network-changed:e62eb4f5-3c82-41c8-bbba-4140a119e597 for instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 on hv-cinder-80382 Jun 15 14:44:37.224929 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-173deda4-e95e-420d-89a4-4e19a8e7fbbc req-98207ecc-d44a-4a92-bd44-92c82ad50b7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041458 Jun 15 14:44:37.230391 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 137/284] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:37.636249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8b124a3d-4514-4029-bea8-695c891861ad tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:37.636622 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8b124a3d-4514-4029-bea8-695c891861ad tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:37.650720 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8b124a3d-4514-4029-bea8-695c891861ad tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:37.651219 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8b124a3d-4514-4029-bea8-695c891861ad tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:37.652803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8b124a3d-4514-4029-bea8-695c891861ad tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:37.653251 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8b124a3d-4514-4029-bea8-695c891861ad tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:37.750482 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8b124a3d-4514-4029-bea8-695c891861ad tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:44:37.773954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-89a47621-4355-49a8-8000-33311300a4d9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:37.775042 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-89a47621-4355-49a8-8000-33311300a4d9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:37.789245 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89a47621-4355-49a8-8000-33311300a4d9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:37.789698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89a47621-4355-49a8-8000-33311300a4d9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:37.790480 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89a47621-4355-49a8-8000-33311300a4d9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:37.790911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89a47621-4355-49a8-8000-33311300a4d9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:37.929200 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8b124a3d-4514-4029-bea8-695c891861ad tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 204 len: 0 microversion: 2.1 time: 0.297486 Jun 15 14:44:37.930144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 148/285] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:44:37 2022] DELETE /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:44:37.939468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4d5e888c-148a-4fd6-9342-cecc96c2d741 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:37.940176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4d5e888c-148a-4fd6-9342-cecc96c2d741 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:37.950291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4d5e888c-148a-4fd6-9342-cecc96c2d741 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:37.950814 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4d5e888c-148a-4fd6-9342-cecc96c2d741 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:37.951964 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4d5e888c-148a-4fd6-9342-cecc96c2d741 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:37.952400 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4d5e888c-148a-4fd6-9342-cecc96c2d741 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:37.995884 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-89a47621-4355-49a8-8000-33311300a4d9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:38.007548 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-89a47621-4355-49a8-8000-33311300a4d9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.238391 Jun 15 14:44:38.008483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 138/286] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:37 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:38.147867 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4d5e888c-148a-4fd6-9342-cecc96c2d741 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:38.156508 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4d5e888c-148a-4fd6-9342-cecc96c2d741 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1553 microversion: 2.1 time: 0.222317 Jun 15 14:44:38.157733 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 149/287] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:37 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:39.027061 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e201ebbf-b2df-44f3-b7bf-e26737db48a2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:39.027973 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e201ebbf-b2df-44f3-b7bf-e26737db48a2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:39.035729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e201ebbf-b2df-44f3-b7bf-e26737db48a2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:39.036406 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e201ebbf-b2df-44f3-b7bf-e26737db48a2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:39.037854 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e201ebbf-b2df-44f3-b7bf-e26737db48a2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:39.038449 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e201ebbf-b2df-44f3-b7bf-e26737db48a2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:39.185174 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5e7d2919-30eb-4309-b79e-0c394802c8d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:39.186132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5e7d2919-30eb-4309-b79e-0c394802c8d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:39.196105 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5e7d2919-30eb-4309-b79e-0c394802c8d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:39.196659 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5e7d2919-30eb-4309-b79e-0c394802c8d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:39.197578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5e7d2919-30eb-4309-b79e-0c394802c8d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:39.198009 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5e7d2919-30eb-4309-b79e-0c394802c8d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:39.201897 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e201ebbf-b2df-44f3-b7bf-e26737db48a2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:39.214880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e201ebbf-b2df-44f3-b7bf-e26737db48a2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.192120 Jun 15 14:44:39.215698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 139/288] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:39 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:39.343231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5e7d2919-30eb-4309-b79e-0c394802c8d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:39.352183 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5e7d2919-30eb-4309-b79e-0c394802c8d8 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1553 microversion: 2.1 time: 0.178186 Jun 15 14:44:39.352840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 150/289] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:39 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:40.232793 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2ae47347-9ed8-4898-b757-e8b1cf2b0534 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:40.234153 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2ae47347-9ed8-4898-b757-e8b1cf2b0534 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:40.249285 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2ae47347-9ed8-4898-b757-e8b1cf2b0534 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:40.250112 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2ae47347-9ed8-4898-b757-e8b1cf2b0534 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:40.251136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2ae47347-9ed8-4898-b757-e8b1cf2b0534 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:40.251805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2ae47347-9ed8-4898-b757-e8b1cf2b0534 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:40.268953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:40.373741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9aed4b71-4f55-4986-bb7e-065131908323 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:40.374360 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9aed4b71-4f55-4986-bb7e-065131908323 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:40.381268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9aed4b71-4f55-4986-bb7e-065131908323 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:40.381832 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9aed4b71-4f55-4986-bb7e-065131908323 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:40.382689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9aed4b71-4f55-4986-bb7e-065131908323 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:40.383223 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9aed4b71-4f55-4986-bb7e-065131908323 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:40.485529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2ae47347-9ed8-4898-b757-e8b1cf2b0534 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:40.498008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2ae47347-9ed8-4898-b757-e8b1cf2b0534 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.269284 Jun 15 14:44:40.509048 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 140/290] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:40 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:40.571748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9aed4b71-4f55-4986-bb7e-065131908323 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:40.581675 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9aed4b71-4f55-4986-bb7e-065131908323 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1553 microversion: 2.1 time: 0.215079 Jun 15 14:44:40.582222 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 151/291] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:40 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:41.515845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e1e9d808-6a81-4d92-8596-e4f686cb4b17 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:41.517217 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e1e9d808-6a81-4d92-8596-e4f686cb4b17 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:41.523947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1e9d808-6a81-4d92-8596-e4f686cb4b17 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:41.524391 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1e9d808-6a81-4d92-8596-e4f686cb4b17 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:41.525157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1e9d808-6a81-4d92-8596-e4f686cb4b17 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:41.525677 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1e9d808-6a81-4d92-8596-e4f686cb4b17 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:41.601365 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-20a51e82-078e-4739-9b68-357ce74e88f5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:41.602477 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-20a51e82-078e-4739-9b68-357ce74e88f5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:41.610367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-20a51e82-078e-4739-9b68-357ce74e88f5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:41.611039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-20a51e82-078e-4739-9b68-357ce74e88f5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:41.611961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-20a51e82-078e-4739-9b68-357ce74e88f5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:41.612770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-20a51e82-078e-4739-9b68-357ce74e88f5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:41.748317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1e9d808-6a81-4d92-8596-e4f686cb4b17 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:41.763496 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e1e9d808-6a81-4d92-8596-e4f686cb4b17 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.247618 Jun 15 14:44:41.764390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 141/292] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:41 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:41.823273 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-20a51e82-078e-4739-9b68-357ce74e88f5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:41.832101 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-20a51e82-078e-4739-9b68-357ce74e88f5 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1553 microversion: 2.1 time: 0.236088 Jun 15 14:44:41.832981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 152/293] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:41 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:42.113629 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-65b6cea9-a229-4671-ba48-b3f04237282a req-6596e97b-ed4e-444b-884f-ea31756b644c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6db7511-cad4-4d72-8939-8dd1483150d1", "name": "network-vif-deleted", "tag": "3fed3571-ad3e-487a-9939-29301e865daa"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:42.122678 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-65b6cea9-a229-4671-ba48-b3f04237282a req-6596e97b-ed4e-444b-884f-ea31756b644c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.122678 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-65b6cea9-a229-4671-ba48-b3f04237282a req-6596e97b-ed4e-444b-884f-ea31756b644c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.296682 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-65b6cea9-a229-4671-ba48-b3f04237282a req-6596e97b-ed4e-444b-884f-ea31756b644c service nova] Creating event network-vif-deleted:3fed3571-ad3e-487a-9939-29301e865daa for instance d6db7511-cad4-4d72-8939-8dd1483150d1 on hv-cinder-80382 Jun 15 14:44:42.304954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-65b6cea9-a229-4671-ba48-b3f04237282a req-6596e97b-ed4e-444b-884f-ea31756b644c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194890 Jun 15 14:44:42.305570 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 142/294] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:42.782864 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ae84ac6a-6fc9-444a-8249-2c0fea401373 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:42.783695 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ae84ac6a-6fc9-444a-8249-2c0fea401373 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:42.786910 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:42.795811 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae84ac6a-6fc9-444a-8249-2c0fea401373 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.796707 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae84ac6a-6fc9-444a-8249-2c0fea401373 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.797749 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae84ac6a-6fc9-444a-8249-2c0fea401373 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.798401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae84ac6a-6fc9-444a-8249-2c0fea401373 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.853026 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:42.854355 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:42.863092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.863541 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.864313 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.865481 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.909180 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.909631 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.910295 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lazy-loading 'fault' on Instance uuid d6db7511-cad4-4d72-8939-8dd1483150d1 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:44:42.976153 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e452beb1eaf540daa9bbfec92e3138cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35be82fde6249bab9008a41cd7ce8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:42.984961 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-65b2cb17-bdb1-444e-b89a-ce81095627bc tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 200 len: 1351 microversion: 2.1 time: 0.138162 Jun 15 14:44:42.995581 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 143/295] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:42 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 1351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:43.016727 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ae84ac6a-6fc9-444a-8249-2c0fea401373 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:43.026092 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ae84ac6a-6fc9-444a-8249-2c0fea401373 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.247428 Jun 15 14:44:43.026671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 153/296] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:42 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:43.561592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-114798197", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:43.616333 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] validate_networks() for None {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:44:43.981973 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:44:43.982560 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:44:43.983054 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:44:43.984463 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:44:43.984463 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:44:43.994527 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:43.995364 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:43.996275 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:43.997060 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.002751 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:44.004113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:44.011801 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:44.012246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.013024 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:44.013452 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.018111 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Getting quotas for project fae043d79ce040e0affb39e23162523a. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:44:44.023463 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Getting quotas for user 453c056ef8674822a0fc93c1c6675664 and project fae043d79ce040e0affb39e23162523a. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:44:44.033886 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] HTTP exception thrown: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Request method failure captured: Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 HTTP/1.1 Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_lksM5B85xNHtbvaF2pP1Sdo9T1ZOt0WVEZI-uhIoeB5RgePklObME_bGSZkXCZDRQlw4HnkoZoM_TI4PtDSMkFjq0sQxcbw8TkeSG2lis5QQ73M9INJJ1HPsvuZSq2_F4f06izxUeHbVyZ6NeV8V7461KcLw8b5izdfGFOif7elc Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: f35be82fde6249bab9008a41cd7ce8d9 Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:44:44.038689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: f35be82fde6249bab9008a41cd7ce8d9 Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-DeleteServersTestJSON-724435217-project Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: e452beb1eaf540daa9bbfec92e3138cb Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-DeleteServersTestJSON-724435217-project Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.040034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': 'd6db7511-cad4-4d72-8939-8dd1483150d1'} Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:44.040732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.041812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.044409 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Returning 404 to user: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:44.044409 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b7c539ac-ac16-4c97-9c7c-71279eaddf78 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 404 len: 111 microversion: 2.1 time: 0.041823 Jun 15 14:44:44.044409 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 154/297] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:43 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:44:44.046003 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-db2c01b1-3a8a-4720-a484-b9a6ac342a6d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:44.046616 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-db2c01b1-3a8a-4720-a484-b9a6ac342a6d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:44.053493 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db2c01b1-3a8a-4720-a484-b9a6ac342a6d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:44.053940 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db2c01b1-3a8a-4720-a484-b9a6ac342a6d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.054905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db2c01b1-3a8a-4720-a484-b9a6ac342a6d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:44.055514 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-db2c01b1-3a8a-4720-a484-b9a6ac342a6d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.056183 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:44:44.058495 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:44:44.160982 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fec88a92-9b60-498e-9258-33d369b8ef1d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605454 Jun 15 14:44:44.161652 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 144/298] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:44:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:44:44.172635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7fc20c21-d001-4166-897a-f9d8dbaf404d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:44.173461 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7fc20c21-d001-4166-897a-f9d8dbaf404d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:44.259459 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7fc20c21-d001-4166-897a-f9d8dbaf404d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:44.268698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7fc20c21-d001-4166-897a-f9d8dbaf404d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1214 microversion: 2.1 time: 0.100631 Jun 15 14:44:44.269299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 145/299] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:44 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:44.270589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-db2c01b1-3a8a-4720-a484-b9a6ac342a6d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:44.283235 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:44.285978 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:44.294304 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-db2c01b1-3a8a-4720-a484-b9a6ac342a6d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.251226 Jun 15 14:44:44.294811 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 155/300] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:44 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:44.296731 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:44.297699 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.299679 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:44.300580 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.324098 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] HTTP exception thrown: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Request method failure captured: Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1/os-volume_attachments HTTP/1.1 Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_lksM5B85xNHtbvaF2pP1Sdo9T1ZOt0WVEZI-uhIoeB5RgePklObME_bGSZkXCZDRQlw4HnkoZoM_TI4PtDSMkFjq0sQxcbw8TkeSG2lis5QQ73M9INJJ1HPsvuZSq2_F4f06izxUeHbVyZ6NeV8V7461KcLw8b5izdfGFOif7elc Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: f35be82fde6249bab9008a41cd7ce8d9 Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:44:44.330641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: f35be82fde6249bab9008a41cd7ce8d9 Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-DeleteServersTestJSON-724435217-project Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: e452beb1eaf540daa9bbfec92e3138cb Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-DeleteServersTestJSON-724435217-project Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.332244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'server_id': 'd6db7511-cad4-4d72-8939-8dd1483150d1'} Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:44.333157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:44.334571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:44.337412 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Returning 404 to user: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:44.338489 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-96c688ec-937b-46d3-8ba8-f43d928adbcf tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066377 Jun 15 14:44:44.339592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 146/301] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:44:44 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1/os-volume_attachments => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:44:45.286286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-77efbe4b-729c-4649-9811-b5c4aa55716b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:45.286925 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-77efbe4b-729c-4649-9811-b5c4aa55716b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:45.293693 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-77efbe4b-729c-4649-9811-b5c4aa55716b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.294141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-77efbe4b-729c-4649-9811-b5c4aa55716b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.295137 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-77efbe4b-729c-4649-9811-b5c4aa55716b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.295701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-77efbe4b-729c-4649-9811-b5c4aa55716b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.312327 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5b40d1a0-8d25-4bd9-8129-518a59d75da9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:45.313537 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5b40d1a0-8d25-4bd9-8129-518a59d75da9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:45.320904 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b40d1a0-8d25-4bd9-8129-518a59d75da9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.321663 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b40d1a0-8d25-4bd9-8129-518a59d75da9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.322634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b40d1a0-8d25-4bd9-8129-518a59d75da9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.323145 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b40d1a0-8d25-4bd9-8129-518a59d75da9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.384447 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-77efbe4b-729c-4649-9811-b5c4aa55716b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:45.393804 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-77efbe4b-729c-4649-9811-b5c4aa55716b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1266 microversion: 2.1 time: 0.111613 Jun 15 14:44:45.395313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 156/302] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:45 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:45.547739 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5b40d1a0-8d25-4bd9-8129-518a59d75da9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:45.566578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5b40d1a0-8d25-4bd9-8129-518a59d75da9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.258054 Jun 15 14:44:45.567390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 147/303] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:45 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:45.597845 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:45.598643 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:45.615150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.615859 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.616824 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.617263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.633034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] HTTP exception thrown: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Request method failure captured: Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: DELETE /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 HTTP/1.1 Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_lksM5B85xNHtbvaF2pP1Sdo9T1ZOt0WVEZI-uhIoeB5RgePklObME_bGSZkXCZDRQlw4HnkoZoM_TI4PtDSMkFjq0sQxcbw8TkeSG2lis5QQ73M9INJJ1HPsvuZSq2_F4f06izxUeHbVyZ6NeV8V7461KcLw8b5izdfGFOif7elc Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: f35be82fde6249bab9008a41cd7ce8d9 Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:44:45.634963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: f35be82fde6249bab9008a41cd7ce8d9 Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-DeleteServersTestJSON-724435217-project Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: e452beb1eaf540daa9bbfec92e3138cb Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-DeleteServersTestJSON-724435217-project Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.636233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': 'd6db7511-cad4-4d72-8939-8dd1483150d1'} Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:45.636883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.637918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.640204 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Returning 404 to user: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:45.641237 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6a04b30c-65e8-4743-9f17-ae88cd9a9474 tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 404 len: 111 microversion: 2.1 time: 0.055920 Jun 15 14:44:45.641635 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 157/304] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:44:45 2022] DELETE /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:44:45.650721 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:45.651698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] [instance: d6db7511-cad4-4d72-8939-8dd1483150d1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:45.669091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.669517 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.670352 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.670865 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.687007 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] HTTP exception thrown: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Request method failure captured: Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 HTTP/1.1 Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_lksM5B85xNHtbvaF2pP1Sdo9T1ZOt0WVEZI-uhIoeB5RgePklObME_bGSZkXCZDRQlw4HnkoZoM_TI4PtDSMkFjq0sQxcbw8TkeSG2lis5QQ73M9INJJ1HPsvuZSq2_F4f06izxUeHbVyZ6NeV8V7461KcLw8b5izdfGFOif7elc Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: f35be82fde6249bab9008a41cd7ce8d9 Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:44:45.689805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f35be82fde6249bab9008a41cd7ce8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: f35be82fde6249bab9008a41cd7ce8d9 Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-DeleteServersTestJSON-724435217 Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-DeleteServersTestJSON-724435217-project Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: e452beb1eaf540daa9bbfec92e3138cb Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-DeleteServersTestJSON-724435217-project Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.691163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'd6db7511-cad4-4d72-8939-8dd1483150d1'} Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:45.691812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. Jun 15 14:44:45.692864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:45.693805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] Returning 404 to user: Instance d6db7511-cad4-4d72-8939-8dd1483150d1 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:45.693805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-507d807c-08cf-400d-9cbe-228df1413e0f tempest-DeleteServersTestJSON-724435217 tempest-DeleteServersTestJSON-724435217-project] 10.222.0.45 "GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1" status: 404 len: 111 microversion: 2.1 time: 0.045048 Jun 15 14:44:45.693805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 148/305] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:45 2022] GET /compute/v2.1/servers/d6db7511-cad4-4d72-8939-8dd1483150d1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:44:46.413669 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e981f78e-1200-4132-b943-0d5cfdb7c848 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:46.414293 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e981f78e-1200-4132-b943-0d5cfdb7c848 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:46.421014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e981f78e-1200-4132-b943-0d5cfdb7c848 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:46.421543 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e981f78e-1200-4132-b943-0d5cfdb7c848 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:46.422356 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e981f78e-1200-4132-b943-0d5cfdb7c848 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:46.422795 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e981f78e-1200-4132-b943-0d5cfdb7c848 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:46.520271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e981f78e-1200-4132-b943-0d5cfdb7c848 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:46.528169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e981f78e-1200-4132-b943-0d5cfdb7c848 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1272 microversion: 2.1 time: 0.118411 Jun 15 14:44:46.528729 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 158/306] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:46 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:46.584708 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f335aa8d-4467-4c26-9f00-53924e061513 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:46.585317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f335aa8d-4467-4c26-9f00-53924e061513 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:46.589678 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:46.593984 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f335aa8d-4467-4c26-9f00-53924e061513 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:46.594638 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f335aa8d-4467-4c26-9f00-53924e061513 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:46.595435 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f335aa8d-4467-4c26-9f00-53924e061513 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:46.596013 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f335aa8d-4467-4c26-9f00-53924e061513 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:46.851648 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f335aa8d-4467-4c26-9f00-53924e061513 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:46.860421 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f335aa8d-4467-4c26-9f00-53924e061513 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.280032 Jun 15 14:44:46.861715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 149/307] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:46 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:47.549844 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ae6cd183-b47e-4307-b778-3b001e6c3db0 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:47.551739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ae6cd183-b47e-4307-b778-3b001e6c3db0 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:47.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae6cd183-b47e-4307-b778-3b001e6c3db0 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:47.566413 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae6cd183-b47e-4307-b778-3b001e6c3db0 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:47.568362 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae6cd183-b47e-4307-b778-3b001e6c3db0 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:47.569450 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ae6cd183-b47e-4307-b778-3b001e6c3db0 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:47.683879 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-9e9e17bc-30fe-4ed7-882d-d26e59420430 req-a9a055bd-9296-4417-84bc-7cd9ba823941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "326742e6-b7d3-4a46-bb51-ab4ac5831a70", "tag": "3ed9ec24-cbe2-4569-b66d-7a964bc2c8b2"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:47.709387 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-9e9e17bc-30fe-4ed7-882d-d26e59420430 req-a9a055bd-9296-4417-84bc-7cd9ba823941 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:47.710218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-9e9e17bc-30fe-4ed7-882d-d26e59420430 req-a9a055bd-9296-4417-84bc-7cd9ba823941 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:47.740952 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-9e9e17bc-30fe-4ed7-882d-d26e59420430 req-a9a055bd-9296-4417-84bc-7cd9ba823941 service nova] Creating event network-changed:3ed9ec24-cbe2-4569-b66d-7a964bc2c8b2 for instance 326742e6-b7d3-4a46-bb51-ab4ac5831a70 on hv-cinder-80382 Jun 15 14:44:47.746136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-9e9e17bc-30fe-4ed7-882d-d26e59420430 req-a9a055bd-9296-4417-84bc-7cd9ba823941 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067109 Jun 15 14:44:47.747306 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 150/308] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:47.834548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ae6cd183-b47e-4307-b778-3b001e6c3db0 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:47.843396 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ae6cd183-b47e-4307-b778-3b001e6c3db0 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1314 microversion: 2.1 time: 0.301041 Jun 15 14:44:47.844211 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 159/309] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:47 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:47.879699 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-be6772be-272a-4a24-aa3a-d91f15766f15 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:47.880442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-be6772be-272a-4a24-aa3a-d91f15766f15 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:47.887531 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be6772be-272a-4a24-aa3a-d91f15766f15 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:47.887979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be6772be-272a-4a24-aa3a-d91f15766f15 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:47.888756 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be6772be-272a-4a24-aa3a-d91f15766f15 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:47.889190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be6772be-272a-4a24-aa3a-d91f15766f15 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:48.089503 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6ebf2468-36e1-42bc-a979-1a528aac4119 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Action: 'create', calling method: .version_select at 0x7f05bc1465e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1025884196", "metadata": {"Type": "work"}}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:48.097120 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-be6772be-272a-4a24-aa3a-d91f15766f15 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:48.105300 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-be6772be-272a-4a24-aa3a-d91f15766f15 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.230047 Jun 15 14:44:48.105856 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 151/310] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:47 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6ebf2468-36e1-42bc-a979-1a528aac4119 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Request method failure captured: Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 122 Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfBfjS1ZgSXhaq8ZCv-IZ2mauol2OEB0OzM0SxV1YgkPlpdAEZC6oL1pxrasc0LCAYgOoZHgvhohEMRZpPTsViDiFRv1vgn5VBNPK6KWkxxsfRF-EFI6XioLmlmeUjjNUQ78M87HW9S35-UFVukme5zjOqmE25YSV6BxxVIxXUQupIU Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:44:48.106313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 936f1335f9894a9495c9c1598a6aaf1b Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1025884196", "metadata": {"Type": "work"}}} Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: Jun 15 14:44:48.107593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1025884196', 'metadata': {'Type': 'work'}}}} Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise error Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:48.108302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 14:44:48.113537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 14:44:48.116017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 14:44:48.116017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.116017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6ebf2468-36e1-42bc-a979-1a528aac4119 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:48.116017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6ebf2468-36e1-42bc-a979-1a528aac4119 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141728 Jun 15 14:44:48.116017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 160/311] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Jun 15 14:44:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 14:44:48.117884 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3b6088a0-5516-464a-83c7-d42080816c17 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Action: 'create', calling method: .version_select at 0x7f05bc2eac10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-239220933", "metadata": {"Type": "work"}}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3b6088a0-5516-464a-83c7-d42080816c17 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Request method failure captured: Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 119 Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfBfjS1ZgSXhaq8ZCv-IZ2mauol2OEB0OzM0SxV1YgkPlpdAEZC6oL1pxrasc0LCAYgOoZHgvhohEMRZpPTsViDiFRv1vgn5VBNPK6KWkxxsfRF-EFI6XioLmlmeUjjNUQ78M87HW9S35-UFVukme5zjOqmE25YSV6BxxVIxXUQupIU Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:44:48.121363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 936f1335f9894a9495c9c1598a6aaf1b Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-239220933", "metadata": {"Type": "work"}}} Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: Jun 15 14:44:48.124371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-239220933', 'metadata': {'Type': 'work'}}}} Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise error Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi '0' Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:48.125096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 14:44:48.126254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 14:44:48.127291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 14:44:48.127291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.127291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3b6088a0-5516-464a-83c7-d42080816c17 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:48.127291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3b6088a0-5516-464a-83c7-d42080816c17 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008743 Jun 15 14:44:48.127291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 152/312] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Jun 15 14:44:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:44:48.133319 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-248d5c24-4a3a-4c08-9071-66d31211bc7b tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Action: 'create', calling method: .version_select at 0x7f05bc133ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-743987331", "metadata": {"Type": "work"}}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-248d5c24-4a3a-4c08-9071-66d31211bc7b tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Request method failure captured: Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 118 Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfBfjS1ZgSXhaq8ZCv-IZ2mauol2OEB0OzM0SxV1YgkPlpdAEZC6oL1pxrasc0LCAYgOoZHgvhohEMRZpPTsViDiFRv1vgn5VBNPK6KWkxxsfRF-EFI6XioLmlmeUjjNUQ78M87HW9S35-UFVukme5zjOqmE25YSV6BxxVIxXUQupIU Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:44:48.135673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 936f1335f9894a9495c9c1598a6aaf1b Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-743987331", "metadata": {"Type": "work"}}} Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: Jun 15 14:44:48.137146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-743987331', 'metadata': {'Type': 'work'}}}} Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise error Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi '' Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:48.138252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 14:44:48.139703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 14:44:48.140836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 14:44:48.140836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.140836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-248d5c24-4a3a-4c08-9071-66d31211bc7b tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:48.140836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-248d5c24-4a3a-4c08-9071-66d31211bc7b tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007576 Jun 15 14:44:48.142897 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 161/313] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Jun 15 14:44:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:44:48.149376 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-06b5e28d-6aba-4498-8dbc-cc077dba1109 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Calling method '.version_select at 0x7f05bc188160>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:48.179731 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-06b5e28d-6aba-4498-8dbc-cc077dba1109 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] HTTP exception thrown: Volume tempest-invalid-1012018683 could not be found. Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-06b5e28d-6aba-4498-8dbc-cc077dba1109 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Request method failure captured: Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1012018683 HTTP/1.1 Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfBfjS1ZgSXhaq8ZCv-IZ2mauol2OEB0OzM0SxV1YgkPlpdAEZC6oL1pxrasc0LCAYgOoZHgvhohEMRZpPTsViDiFRv1vgn5VBNPK6KWkxxsfRF-EFI6XioLmlmeUjjNUQ78M87HW9S35-UFVukme5zjOqmE25YSV6BxxVIxXUQupIU Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:44:48.182423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 936f1335f9894a9495c9c1598a6aaf1b Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Volume tempest-invalid-1012018683 could not be found. Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'tempest-invalid-1012018683'} Jun 15 14:44:48.183803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1012018683 could not be found. (HTTP 404) (Request-ID: req-525c91f9-0ab8-438f-a0a3-517fcdfbfe93) Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.184659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:44:48.185911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1012018683 could not be found. Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:48.187132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1012018683 could not be found. Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1012018683 could not be found. Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-06b5e28d-6aba-4498-8dbc-cc077dba1109 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Returning 404 to user: Volume tempest-invalid-1012018683 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-06b5e28d-6aba-4498-8dbc-cc077dba1109 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1012018683" status: 404 len: 99 microversion: 2.1 time: 0.039893 Jun 15 14:44:48.188211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 153/314] 10.222.0.45 () {58 vars in 1217 bytes} [Wed Jun 15 14:44:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1012018683 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 15 14:44:48.195950 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cec32223-cff5-43db-863f-bcd3f63f3fbd tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005487 Jun 15 14:44:48.196463 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 162/315] 10.222.0.45 () {58 vars in 1139 bytes} [Wed Jun 15 14:44:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 14:44:48.205330 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-605152ac-e2ae-40da-a1bd-1664ebdf44ed tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003830 Jun 15 14:44:48.205923 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 154/316] 10.222.0.45 () {58 vars in 1136 bytes} [Wed Jun 15 14:44:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 14:44:48.215376 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5bd98e25-7278-40c3-a6de-ad1e5689dee9 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Calling method '.version_select at 0x7f05bc133d30>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:48.244396 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-5bd98e25-7278-40c3-a6de-ad1e5689dee9 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] HTTP exception thrown: Volume b33a8a43-f594-4514-a0c7-527046a25889 could not be found. Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5bd98e25-7278-40c3-a6de-ad1e5689dee9 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Request method failure captured: Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: DELETE /compute/v2.1/os-volumes/b33a8a43-f594-4514-a0c7-527046a25889 HTTP/1.1 Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfBfjS1ZgSXhaq8ZCv-IZ2mauol2OEB0OzM0SxV1YgkPlpdAEZC6oL1pxrasc0LCAYgOoZHgvhohEMRZpPTsViDiFRv1vgn5VBNPK6KWkxxsfRF-EFI6XioLmlmeUjjNUQ78M87HW9S35-UFVukme5zjOqmE25YSV6BxxVIxXUQupIU Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:44:48.247326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 936f1335f9894a9495c9c1598a6aaf1b Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Volume b33a8a43-f594-4514-a0c7-527046a25889 could not be found. Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': 'b33a8a43-f594-4514-a0c7-527046a25889'} Jun 15 14:44:48.248860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b33a8a43-f594-4514-a0c7-527046a25889 could not be found. (HTTP 404) (Request-ID: req-5abf9363-4a30-4953-82a8-b3b30e92eee1) Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.249701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:44:48.250892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b33a8a43-f594-4514-a0c7-527046a25889 could not be found. Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 14:44:48.252022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b33a8a43-f594-4514-a0c7-527046a25889 could not be found. Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b33a8a43-f594-4514-a0c7-527046a25889 could not be found. Jun 15 14:44:48.253194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.254662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5bd98e25-7278-40c3-a6de-ad1e5689dee9 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Returning 404 to user: Volume b33a8a43-f594-4514-a0c7-527046a25889 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:48.256108 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5bd98e25-7278-40c3-a6de-ad1e5689dee9 tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/b33a8a43-f594-4514-a0c7-527046a25889" status: 404 len: 109 microversion: 2.1 time: 0.044104 Jun 15 14:44:48.256668 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 163/317] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 14:44:48 2022] DELETE /compute/v2.1/os-volumes/b33a8a43-f594-4514-a0c7-527046a25889 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:44:48.265675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-39483f4f-e4b3-40ef-bbd4-97651dfe525f tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Calling method '.version_select at 0x7f05bc2eac10>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:48.301123 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-39483f4f-e4b3-40ef-bbd4-97651dfe525f tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] HTTP exception thrown: Volume 5f3ccf61-765e-47d3-9db1-1a76a85494e8 could not be found. Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-39483f4f-e4b3-40ef-bbd4-97651dfe525f tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Request method failure captured: Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/os-volumes/5f3ccf61-765e-47d3-9db1-1a76a85494e8 HTTP/1.1 Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfBfjS1ZgSXhaq8ZCv-IZ2mauol2OEB0OzM0SxV1YgkPlpdAEZC6oL1pxrasc0LCAYgOoZHgvhohEMRZpPTsViDiFRv1vgn5VBNPK6KWkxxsfRF-EFI6XioLmlmeUjjNUQ78M87HW9S35-UFVukme5zjOqmE25YSV6BxxVIxXUQupIU Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:44:48.303240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92c72b8fab7e4ac0a08f7207e9877013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 92c72b8fab7e4ac0a08f7207e9877013 Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesNegativeTest-1125141034 Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 936f1335f9894a9495c9c1598a6aaf1b Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesNegativeTest-1125141034-project Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Volume 5f3ccf61-765e-47d3-9db1-1a76a85494e8 could not be found. Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '5f3ccf61-765e-47d3-9db1-1a76a85494e8'} Jun 15 14:44:48.305014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f3ccf61-765e-47d3-9db1-1a76a85494e8 could not be found. (HTTP 404) (Request-ID: req-82e56175-49c6-4253-9ae5-df7db79e430d) Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.305977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:44:48.307598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f3ccf61-765e-47d3-9db1-1a76a85494e8 could not be found. Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:44:48.308706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f3ccf61-765e-47d3-9db1-1a76a85494e8 could not be found. Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f3ccf61-765e-47d3-9db1-1a76a85494e8 could not be found. Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-39483f4f-e4b3-40ef-bbd4-97651dfe525f tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] Returning 404 to user: Volume 5f3ccf61-765e-47d3-9db1-1a76a85494e8 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-39483f4f-e4b3-40ef-bbd4-97651dfe525f tempest-VolumesNegativeTest-1125141034 tempest-VolumesNegativeTest-1125141034-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5f3ccf61-765e-47d3-9db1-1a76a85494e8" status: 404 len: 109 microversion: 2.1 time: 0.042876 Jun 15 14:44:48.310303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 155/318] 10.222.0.45 () {58 vars in 1244 bytes} [Wed Jun 15 14:44:48 2022] GET /compute/v2.1/os-volumes/5f3ccf61-765e-47d3-9db1-1a76a85494e8 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:44:48.865552 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-03774902-cefc-438b-8e76-70ced6841fdf tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:48.866848 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-03774902-cefc-438b-8e76-70ced6841fdf tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:48.875580 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03774902-cefc-438b-8e76-70ced6841fdf tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:48.876463 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03774902-cefc-438b-8e76-70ced6841fdf tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:48.877544 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03774902-cefc-438b-8e76-70ced6841fdf tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:48.878402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03774902-cefc-438b-8e76-70ced6841fdf tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:49.084198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-03774902-cefc-438b-8e76-70ced6841fdf tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:49.092276 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-03774902-cefc-438b-8e76-70ced6841fdf tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1314 microversion: 2.1 time: 0.233449 Jun 15 14:44:49.092771 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 164/319] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:48 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:49.127130 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fd1cce6a-6f0c-4f2f-a5a0-00a7829798f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:49.128012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fd1cce6a-6f0c-4f2f-a5a0-00a7829798f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:49.138484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fd1cce6a-6f0c-4f2f-a5a0-00a7829798f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:49.138484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fd1cce6a-6f0c-4f2f-a5a0-00a7829798f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:49.138484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fd1cce6a-6f0c-4f2f-a5a0-00a7829798f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:49.138484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fd1cce6a-6f0c-4f2f-a5a0-00a7829798f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:49.319274 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fd1cce6a-6f0c-4f2f-a5a0-00a7829798f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:49.327406 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fd1cce6a-6f0c-4f2f-a5a0-00a7829798f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.206511 Jun 15 14:44:49.327986 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 156/320] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:49 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:50.110193 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6006531b-4e91-4e45-87cb-ad070ef87482 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:50.111598 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6006531b-4e91-4e45-87cb-ad070ef87482 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:50.119506 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6006531b-4e91-4e45-87cb-ad070ef87482 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:50.120318 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6006531b-4e91-4e45-87cb-ad070ef87482 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:50.121435 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6006531b-4e91-4e45-87cb-ad070ef87482 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:50.122237 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6006531b-4e91-4e45-87cb-ad070ef87482 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:50.332886 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6006531b-4e91-4e45-87cb-ad070ef87482 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:50.336282 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:50.344285 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6006531b-4e91-4e45-87cb-ad070ef87482 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1314 microversion: 2.1 time: 0.237939 Jun 15 14:44:50.345101 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 165/321] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:50 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:50.358590 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ffbaab8a-00bb-4b2f-8314-86bc214e07e9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:50.359652 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ffbaab8a-00bb-4b2f-8314-86bc214e07e9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:50.369890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ffbaab8a-00bb-4b2f-8314-86bc214e07e9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:50.370598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ffbaab8a-00bb-4b2f-8314-86bc214e07e9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:50.371421 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ffbaab8a-00bb-4b2f-8314-86bc214e07e9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:50.371863 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ffbaab8a-00bb-4b2f-8314-86bc214e07e9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:50.519861 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ffbaab8a-00bb-4b2f-8314-86bc214e07e9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:50.528322 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ffbaab8a-00bb-4b2f-8314-86bc214e07e9 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.186522 Jun 15 14:44:50.528892 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 157/322] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:50 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:51.371440 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-712ca3d8-0fb4-422b-a96d-993497b29af3 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:51.372052 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-712ca3d8-0fb4-422b-a96d-993497b29af3 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:51.379086 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-712ca3d8-0fb4-422b-a96d-993497b29af3 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:51.379541 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-712ca3d8-0fb4-422b-a96d-993497b29af3 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:51.380358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-712ca3d8-0fb4-422b-a96d-993497b29af3 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:51.380799 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-712ca3d8-0fb4-422b-a96d-993497b29af3 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:51.548328 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ec87e37a-ba03-4426-8e35-9ef4281b1948 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:51.549081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ec87e37a-ba03-4426-8e35-9ef4281b1948 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:51.558544 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec87e37a-ba03-4426-8e35-9ef4281b1948 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:51.559106 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec87e37a-ba03-4426-8e35-9ef4281b1948 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:51.560809 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec87e37a-ba03-4426-8e35-9ef4281b1948 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:51.561335 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec87e37a-ba03-4426-8e35-9ef4281b1948 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:51.798454 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-712ca3d8-0fb4-422b-a96d-993497b29af3 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:51.803524 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ec87e37a-ba03-4426-8e35-9ef4281b1948 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:51.807361 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-712ca3d8-0fb4-422b-a96d-993497b29af3 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1314 microversion: 2.1 time: 0.440737 Jun 15 14:44:51.807950 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 166/323] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:51 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:51.812221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ec87e37a-ba03-4426-8e35-9ef4281b1948 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.269068 Jun 15 14:44:51.812976 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 158/324] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:51 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:52.825047 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c6510aab-ff0d-4567-9724-9003efd6b59d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:52.825660 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c6510aab-ff0d-4567-9724-9003efd6b59d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:52.830204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-54234594-d892-454b-bfa6-9a177d2c523c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:52.831042 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-54234594-d892-454b-bfa6-9a177d2c523c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:52.832357 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c6510aab-ff0d-4567-9724-9003efd6b59d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:52.832812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c6510aab-ff0d-4567-9724-9003efd6b59d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:52.834541 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c6510aab-ff0d-4567-9724-9003efd6b59d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:52.835190 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c6510aab-ff0d-4567-9724-9003efd6b59d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:52.839217 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54234594-d892-454b-bfa6-9a177d2c523c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:52.839663 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54234594-d892-454b-bfa6-9a177d2c523c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:52.840441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54234594-d892-454b-bfa6-9a177d2c523c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:52.840879 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54234594-d892-454b-bfa6-9a177d2c523c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:53.140366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-54234594-d892-454b-bfa6-9a177d2c523c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:53.147946 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-54234594-d892-454b-bfa6-9a177d2c523c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.322097 Jun 15 14:44:53.148516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 159/325] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:52 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:53.149900 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c6510aab-ff0d-4567-9724-9003efd6b59d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:53.158498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c6510aab-ff0d-4567-9724-9003efd6b59d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1314 microversion: 2.1 time: 0.337416 Jun 15 14:44:53.159082 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 167/326] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:52 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:54.164953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fea016e7-170a-478d-aa53-924799594e50 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:54.165592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fea016e7-170a-478d-aa53-924799594e50 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:54.168215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:54.173509 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fea016e7-170a-478d-aa53-924799594e50 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:54.173954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fea016e7-170a-478d-aa53-924799594e50 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:54.174712 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fea016e7-170a-478d-aa53-924799594e50 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:54.175172 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fea016e7-170a-478d-aa53-924799594e50 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:54.175489 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c4f9cf1a-0b01-4d9a-b533-138fd68bddf2 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:54.176100 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c4f9cf1a-0b01-4d9a-b533-138fd68bddf2 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:54.181979 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c4f9cf1a-0b01-4d9a-b533-138fd68bddf2 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:54.182425 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c4f9cf1a-0b01-4d9a-b533-138fd68bddf2 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:54.183198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c4f9cf1a-0b01-4d9a-b533-138fd68bddf2 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:54.183636 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c4f9cf1a-0b01-4d9a-b533-138fd68bddf2 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:54.268670 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=8 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:54.364586 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fea016e7-170a-478d-aa53-924799594e50 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:54.372700 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c4f9cf1a-0b01-4d9a-b533-138fd68bddf2 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:54.373130 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fea016e7-170a-478d-aa53-924799594e50 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.212553 Jun 15 14:44:54.373882 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 160/327] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:54 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:54.381468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c4f9cf1a-0b01-4d9a-b533-138fd68bddf2 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1314 microversion: 2.1 time: 0.209731 Jun 15 14:44:54.382028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 168/328] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:54 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:55.209908 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-cc0b170a-22f2-4a5e-b685-0d4e77b0b0a5 req-5d6d381b-072e-486a-85ce-17531d60fa57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326742e6-b7d3-4a46-bb51-ab4ac5831a70", "name": "network-vif-plugged", "status": "completed", "tag": "3ed9ec24-cbe2-4569-b66d-7a964bc2c8b2"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:55.224849 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-cc0b170a-22f2-4a5e-b685-0d4e77b0b0a5 req-5d6d381b-072e-486a-85ce-17531d60fa57 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:55.225638 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-cc0b170a-22f2-4a5e-b685-0d4e77b0b0a5 req-5d6d381b-072e-486a-85ce-17531d60fa57 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:55.240867 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-cc0b170a-22f2-4a5e-b685-0d4e77b0b0a5 req-5d6d381b-072e-486a-85ce-17531d60fa57 service nova] Creating event network-vif-plugged:3ed9ec24-cbe2-4569-b66d-7a964bc2c8b2 for instance 326742e6-b7d3-4a46-bb51-ab4ac5831a70 on hv-cinder-80382 Jun 15 14:44:55.248170 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-cc0b170a-22f2-4a5e-b685-0d4e77b0b0a5 req-5d6d381b-072e-486a-85ce-17531d60fa57 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042173 Jun 15 14:44:55.249346 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 161/329] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:55.391226 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7a5df4ff-224b-4b69-8f3d-1571fca10b77 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:55.391762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7a5df4ff-224b-4b69-8f3d-1571fca10b77 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:55.398329 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7a5df4ff-224b-4b69-8f3d-1571fca10b77 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:55.398783 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7a5df4ff-224b-4b69-8f3d-1571fca10b77 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:55.399589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7a5df4ff-224b-4b69-8f3d-1571fca10b77 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:55.400054 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7a5df4ff-224b-4b69-8f3d-1571fca10b77 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:55.405147 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ec09dd76-adf4-4c84-9871-adccbbd80d32 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:55.405838 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ec09dd76-adf4-4c84-9871-adccbbd80d32 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:55.415484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec09dd76-adf4-4c84-9871-adccbbd80d32 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:55.415944 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec09dd76-adf4-4c84-9871-adccbbd80d32 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:55.416845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec09dd76-adf4-4c84-9871-adccbbd80d32 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:55.417300 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec09dd76-adf4-4c84-9871-adccbbd80d32 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:55.665261 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7a5df4ff-224b-4b69-8f3d-1571fca10b77 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:55.673401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7a5df4ff-224b-4b69-8f3d-1571fca10b77 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.286547 Jun 15 14:44:55.674198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 169/330] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:55 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:55.688923 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ec09dd76-adf4-4c84-9871-adccbbd80d32 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:55.697062 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ec09dd76-adf4-4c84-9871-adccbbd80d32 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1314 microversion: 2.1 time: 0.297914 Jun 15 14:44:55.697622 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 162/331] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:55 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:56.690891 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f0e8fb0e-76e7-42a4-901f-7bab90f8a0eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:56.692599 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f0e8fb0e-76e7-42a4-901f-7bab90f8a0eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:56.701222 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f0e8fb0e-76e7-42a4-901f-7bab90f8a0eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:56.702165 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f0e8fb0e-76e7-42a4-901f-7bab90f8a0eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:56.703558 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f0e8fb0e-76e7-42a4-901f-7bab90f8a0eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:56.704269 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f0e8fb0e-76e7-42a4-901f-7bab90f8a0eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:56.715093 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3c82713c-735e-4cb5-acac-542da77835e1 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:56.715877 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3c82713c-735e-4cb5-acac-542da77835e1 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:56.728113 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3c82713c-735e-4cb5-acac-542da77835e1 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:56.728559 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3c82713c-735e-4cb5-acac-542da77835e1 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:56.729319 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3c82713c-735e-4cb5-acac-542da77835e1 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:56.731753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3c82713c-735e-4cb5-acac-542da77835e1 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:56.956341 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f0e8fb0e-76e7-42a4-901f-7bab90f8a0eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:56.966390 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f0e8fb0e-76e7-42a4-901f-7bab90f8a0eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.279867 Jun 15 14:44:56.967517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 170/332] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:56 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:57.004668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3c82713c-735e-4cb5-acac-542da77835e1 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:57.017245 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3c82713c-735e-4cb5-acac-542da77835e1 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1314 microversion: 2.1 time: 0.306955 Jun 15 14:44:57.018126 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 163/333] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:56 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:57.985040 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cfff2300-cd7b-4155-8db4-01418d5f8c8b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:57.985650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cfff2300-cd7b-4155-8db4-01418d5f8c8b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:57.993978 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cfff2300-cd7b-4155-8db4-01418d5f8c8b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:57.994430 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cfff2300-cd7b-4155-8db4-01418d5f8c8b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:57.995274 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cfff2300-cd7b-4155-8db4-01418d5f8c8b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:57.995708 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cfff2300-cd7b-4155-8db4-01418d5f8c8b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.037125 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-83c0cac7-d4a8-47d2-8de7-93ec75749a64 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:58.037983 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-83c0cac7-d4a8-47d2-8de7-93ec75749a64 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:58.047750 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83c0cac7-d4a8-47d2-8de7-93ec75749a64 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:58.048564 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83c0cac7-d4a8-47d2-8de7-93ec75749a64 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.049422 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83c0cac7-d4a8-47d2-8de7-93ec75749a64 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:58.049941 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83c0cac7-d4a8-47d2-8de7-93ec75749a64 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.200256 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cfff2300-cd7b-4155-8db4-01418d5f8c8b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:58.220664 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cfff2300-cd7b-4155-8db4-01418d5f8c8b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.239192 Jun 15 14:44:58.221724 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 171/334] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:57 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:58.257169 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-83c0cac7-d4a8-47d2-8de7-93ec75749a64 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:58.266325 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-83c0cac7-d4a8-47d2-8de7-93ec75749a64 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1463 microversion: 2.1 time: 0.234398 Jun 15 14:44:58.267107 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 164/335] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:58 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1463 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:58.312013 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5fed2b97-0479-47f6-9c5d-ab01178e993a tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:58.312818 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5fed2b97-0479-47f6-9c5d-ab01178e993a tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:58.320670 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5fed2b97-0479-47f6-9c5d-ab01178e993a tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:58.321106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5fed2b97-0479-47f6-9c5d-ab01178e993a tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.321875 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5fed2b97-0479-47f6-9c5d-ab01178e993a tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:58.322304 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5fed2b97-0479-47f6-9c5d-ab01178e993a tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.347780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5fed2b97-0479-47f6-9c5d-ab01178e993a tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:44:58.438874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5fed2b97-0479-47f6-9c5d-ab01178e993a tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "DELETE /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 204 len: 0 microversion: 2.1 time: 0.131357 Jun 15 14:44:58.439395 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 172/336] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:44:58 2022] DELETE /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:44:58.448338 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eec42c94-5b65-4351-9006-8fbb85326456 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:58.449063 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-eec42c94-5b65-4351-9006-8fbb85326456 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:58.455157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eec42c94-5b65-4351-9006-8fbb85326456 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:58.455711 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eec42c94-5b65-4351-9006-8fbb85326456 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.456557 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eec42c94-5b65-4351-9006-8fbb85326456 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:58.457110 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eec42c94-5b65-4351-9006-8fbb85326456 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.594397 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-eec42c94-5b65-4351-9006-8fbb85326456 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:58.596944 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:58.603639 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-eec42c94-5b65-4351-9006-8fbb85326456 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1469 microversion: 2.1 time: 0.159141 Jun 15 14:44:58.604202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 165/337] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:58 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:59.240121 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-532aa966-495a-4ebd-b6a6-2e1b7e8c9736 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:59.240840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-532aa966-495a-4ebd-b6a6-2e1b7e8c9736 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:59.247086 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-532aa966-495a-4ebd-b6a6-2e1b7e8c9736 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:59.247535 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-532aa966-495a-4ebd-b6a6-2e1b7e8c9736 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:59.248303 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-532aa966-495a-4ebd-b6a6-2e1b7e8c9736 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:59.248737 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-532aa966-495a-4ebd-b6a6-2e1b7e8c9736 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:59.384056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-532aa966-495a-4ebd-b6a6-2e1b7e8c9736 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:59.391417 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-532aa966-495a-4ebd-b6a6-2e1b7e8c9736 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.157165 Jun 15 14:44:59.391974 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 173/338] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:59 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:59.621935 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0b773a2b-de88-41f1-9ab2-0cf53e24ff88 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:59.622544 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0b773a2b-de88-41f1-9ab2-0cf53e24ff88 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:59.629029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b773a2b-de88-41f1-9ab2-0cf53e24ff88 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:59.629476 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b773a2b-de88-41f1-9ab2-0cf53e24ff88 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:59.630238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b773a2b-de88-41f1-9ab2-0cf53e24ff88 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:59.630672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b773a2b-de88-41f1-9ab2-0cf53e24ff88 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:59.763734 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0b773a2b-de88-41f1-9ab2-0cf53e24ff88 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:59.771730 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0b773a2b-de88-41f1-9ab2-0cf53e24ff88 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1469 microversion: 2.1 time: 0.153071 Jun 15 14:44:59.772294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 166/339] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:59 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:00.407869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6e9eb21c-a7c8-450a-b437-3df50f61e512 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:00.408484 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6e9eb21c-a7c8-450a-b437-3df50f61e512 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:00.414572 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e9eb21c-a7c8-450a-b437-3df50f61e512 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:00.415037 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e9eb21c-a7c8-450a-b437-3df50f61e512 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:00.415961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e9eb21c-a7c8-450a-b437-3df50f61e512 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:00.416550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e9eb21c-a7c8-450a-b437-3df50f61e512 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:00.570221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6e9eb21c-a7c8-450a-b437-3df50f61e512 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:00.577706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6e9eb21c-a7c8-450a-b437-3df50f61e512 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.173707 Jun 15 14:45:00.578269 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 174/340] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:00 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:00.789325 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9f252824-d295-4fbd-bfbf-110ee1be3489 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:00.790056 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9f252824-d295-4fbd-bfbf-110ee1be3489 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:00.797332 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f252824-d295-4fbd-bfbf-110ee1be3489 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:00.797774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f252824-d295-4fbd-bfbf-110ee1be3489 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:00.798528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f252824-d295-4fbd-bfbf-110ee1be3489 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:00.798963 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f252824-d295-4fbd-bfbf-110ee1be3489 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:00.938127 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9f252824-d295-4fbd-bfbf-110ee1be3489 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:00.946950 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9f252824-d295-4fbd-bfbf-110ee1be3489 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1469 microversion: 2.1 time: 0.161400 Jun 15 14:45:00.947571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 167/341] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:00 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:01.595247 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-38a28b30-64df-48d9-b568-3f7965fc0508 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:01.595676 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-38a28b30-64df-48d9-b568-3f7965fc0508 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:01.601751 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-38a28b30-64df-48d9-b568-3f7965fc0508 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:01.602202 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-38a28b30-64df-48d9-b568-3f7965fc0508 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:01.603006 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-38a28b30-64df-48d9-b568-3f7965fc0508 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:01.603498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-38a28b30-64df-48d9-b568-3f7965fc0508 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:01.756846 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-38a28b30-64df-48d9-b568-3f7965fc0508 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:01.766838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-38a28b30-64df-48d9-b568-3f7965fc0508 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.175889 Jun 15 14:45:01.767508 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 175/342] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:01 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:01.964603 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c8b8222f-dc7c-4c87-a4fb-1126e505b90d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:01.965211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c8b8222f-dc7c-4c87-a4fb-1126e505b90d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:01.971733 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8b8222f-dc7c-4c87-a4fb-1126e505b90d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:01.972174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8b8222f-dc7c-4c87-a4fb-1126e505b90d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:01.972921 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8b8222f-dc7c-4c87-a4fb-1126e505b90d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:01.973348 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8b8222f-dc7c-4c87-a4fb-1126e505b90d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:02.110665 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c8b8222f-dc7c-4c87-a4fb-1126e505b90d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:02.118889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c8b8222f-dc7c-4c87-a4fb-1126e505b90d tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1469 microversion: 2.1 time: 0.158158 Jun 15 14:45:02.119695 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 168/343] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:01 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:02.785703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2acea409-8da9-4b7e-a790-7f005423ee0f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:02.786436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2acea409-8da9-4b7e-a790-7f005423ee0f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:02.793135 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2acea409-8da9-4b7e-a790-7f005423ee0f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:02.793583 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2acea409-8da9-4b7e-a790-7f005423ee0f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:02.794372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2acea409-8da9-4b7e-a790-7f005423ee0f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:02.794808 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2acea409-8da9-4b7e-a790-7f005423ee0f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:03.064366 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2acea409-8da9-4b7e-a790-7f005423ee0f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:03.076991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2acea409-8da9-4b7e-a790-7f005423ee0f tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1521 microversion: 2.1 time: 0.295029 Jun 15 14:45:03.077817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 176/344] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:02 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:03.136363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-98ebe5a5-8895-494b-8eda-32684e4c5363 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:03.137119 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-98ebe5a5-8895-494b-8eda-32684e4c5363 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:03.143836 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-98ebe5a5-8895-494b-8eda-32684e4c5363 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:03.144287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-98ebe5a5-8895-494b-8eda-32684e4c5363 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:03.145049 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-98ebe5a5-8895-494b-8eda-32684e4c5363 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:03.145476 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-98ebe5a5-8895-494b-8eda-32684e4c5363 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:03.346531 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-98ebe5a5-8895-494b-8eda-32684e4c5363 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:03.355089 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-98ebe5a5-8895-494b-8eda-32684e4c5363 tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1469 microversion: 2.1 time: 0.222509 Jun 15 14:45:03.355672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 169/345] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:03 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1469 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:03.487378 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-005f3d78-7188-411f-b6d0-3ca41ad70e7f req-e0d3e024-138e-4333-93b7-3260e01c24d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326742e6-b7d3-4a46-bb51-ab4ac5831a70", "name": "network-vif-deleted", "tag": "3ed9ec24-cbe2-4569-b66d-7a964bc2c8b2"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:03.495923 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-005f3d78-7188-411f-b6d0-3ca41ad70e7f req-e0d3e024-138e-4333-93b7-3260e01c24d3 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:03.496370 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-005f3d78-7188-411f-b6d0-3ca41ad70e7f req-e0d3e024-138e-4333-93b7-3260e01c24d3 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:03.508886 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-005f3d78-7188-411f-b6d0-3ca41ad70e7f req-e0d3e024-138e-4333-93b7-3260e01c24d3 service nova] Creating event network-vif-deleted:3ed9ec24-cbe2-4569-b66d-7a964bc2c8b2 for instance 326742e6-b7d3-4a46-bb51-ab4ac5831a70 on hv-cinder-80382 Jun 15 14:45:03.514000 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-005f3d78-7188-411f-b6d0-3ca41ad70e7f req-e0d3e024-138e-4333-93b7-3260e01c24d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030551 Jun 15 14:45:03.514685 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 177/346] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:04.095445 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fbc7efff-9ea3-43a0-97b9-f80864c24f78 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:04.096077 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fbc7efff-9ea3-43a0-97b9-f80864c24f78 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:04.102828 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fbc7efff-9ea3-43a0-97b9-f80864c24f78 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:04.103314 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fbc7efff-9ea3-43a0-97b9-f80864c24f78 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.104090 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fbc7efff-9ea3-43a0-97b9-f80864c24f78 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:04.104676 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fbc7efff-9ea3-43a0-97b9-f80864c24f78 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.255409 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fbc7efff-9ea3-43a0-97b9-f80864c24f78 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:04.263425 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fbc7efff-9ea3-43a0-97b9-f80864c24f78 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1501 microversion: 2.1 time: 0.171932 Jun 15 14:45:04.263988 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 170/347] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:04 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:04.280791 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c654ef24-827f-4b96-b5f9-62591da1a584 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:04.281489 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c654ef24-827f-4b96-b5f9-62591da1a584 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:04.291521 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c654ef24-827f-4b96-b5f9-62591da1a584 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:04.296996 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c654ef24-827f-4b96-b5f9-62591da1a584 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.298235 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c654ef24-827f-4b96-b5f9-62591da1a584 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:04.298695 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c654ef24-827f-4b96-b5f9-62591da1a584 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.374718 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:04.375515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:04.382472 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:04.383170 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.384252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:04.384793 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.430517 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:04.431144 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.431836 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lazy-loading 'fault' on Instance uuid 326742e6-b7d3-4a46-bb51-ab4ac5831a70 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:45:04.470056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c654ef24-827f-4b96-b5f9-62591da1a584 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:04.479322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c654ef24-827f-4b96-b5f9-62591da1a584 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1516 microversion: 2.1 time: 0.202748 Jun 15 14:45:04.479914 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 178/348] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:04 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:04.491123 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453c056ef8674822a0fc93c1c6675664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae043d79ce040e0affb39e23162523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:04.500697 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0724b4e2-c26d-4416-829e-ea25ce90146b tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 200 len: 1304 microversion: 2.1 time: 0.130804 Jun 15 14:45:04.501501 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 171/349] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:04 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:05.517514 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:05.518949 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] [instance: 326742e6-b7d3-4a46-bb51-ab4ac5831a70] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:05.525934 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:05.526459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:05.527369 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:05.528142 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:05.541377 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] HTTP exception thrown: Instance 326742e6-b7d3-4a46-bb51-ab4ac5831a70 could not be found. Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Request method failure captured: Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 HTTP/1.1 Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfBY4tGGAerimo06vxgrnGFgzweVFkCkuHYXpzcxVv7xUW5jj8FNHX1vWIUecWF6CGsbUidWd-AJ9_t4RPIWhKkXv5R5kvEItki8xGJ2oFASkrLsxTMIaNX9GKz8XmDZQ_21cofsgbBOG6sDWZVePYn_IbDA5XJ7ucId_LV9FMMiPGw Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: fae043d79ce040e0affb39e23162523a Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-VolumesNegativeTest-1833743463 Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:45:05.543073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fae043d79ce040e0affb39e23162523a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fae043d79ce040e0affb39e23162523a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fae043d79ce040e0affb39e23162523a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fae043d79ce040e0affb39e23162523a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-VolumesNegativeTest-1833743463 Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: fae043d79ce040e0affb39e23162523a Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-VolumesNegativeTest-1833743463 Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-VolumesNegativeTest-1833743463-project Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 453c056ef8674822a0fc93c1c6675664 Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-VolumesNegativeTest-1833743463-project Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 326742e6-b7d3-4a46-bb51-ab4ac5831a70 could not be found. Jun 15 14:45:05.544403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '326742e6-b7d3-4a46-bb51-ab4ac5831a70'} Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 326742e6-b7d3-4a46-bb51-ab4ac5831a70 could not be found. Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:45:05.545283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 326742e6-b7d3-4a46-bb51-ab4ac5831a70 could not be found. Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 326742e6-b7d3-4a46-bb51-ab4ac5831a70 could not be found. Jun 15 14:45:05.546739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:05.547842 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] Returning 404 to user: Instance 326742e6-b7d3-4a46-bb51-ab4ac5831a70 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:45:05.547842 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2bedf7dd-e8ac-4450-a2f0-1cd49972387e tempest-VolumesNegativeTest-1833743463 tempest-VolumesNegativeTest-1833743463-project] 10.222.0.45 "GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70" status: 404 len: 111 microversion: 2.1 time: 0.030834 Jun 15 14:45:05.547842 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 179/350] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:05 2022] GET /compute/v2.1/servers/326742e6-b7d3-4a46-bb51-ab4ac5831a70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:45:05.916126 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-93ba22c3-ee8f-4cce-adf1-0f3598611e68 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:05.917911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-93ba22c3-ee8f-4cce-adf1-0f3598611e68 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:05.934118 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93ba22c3-ee8f-4cce-adf1-0f3598611e68 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:05.934813 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93ba22c3-ee8f-4cce-adf1-0f3598611e68 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:05.935843 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93ba22c3-ee8f-4cce-adf1-0f3598611e68 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:05.936636 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93ba22c3-ee8f-4cce-adf1-0f3598611e68 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:05.962595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-93ba22c3-ee8f-4cce-adf1-0f3598611e68 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lazy-loading 'flavor' on Instance uuid c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:45:06.081055 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-93ba22c3-ee8f-4cce-adf1-0f3598611e68 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66/action" status: 200 len: 32 microversion: 2.1 time: 0.171662 Jun 15 14:45:06.082173 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 172/351] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:45:05 2022] POST /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 14:45:06.091627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-66b9e8fc-94e2-4ff0-b5ba-dddb030ee6bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:06.092644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-66b9e8fc-94e2-4ff0-b5ba-dddb030ee6bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:06.101410 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-66b9e8fc-94e2-4ff0-b5ba-dddb030ee6bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:06.102014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-66b9e8fc-94e2-4ff0-b5ba-dddb030ee6bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:06.102985 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-66b9e8fc-94e2-4ff0-b5ba-dddb030ee6bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:06.103584 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-66b9e8fc-94e2-4ff0-b5ba-dddb030ee6bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:06.315613 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-66b9e8fc-94e2-4ff0-b5ba-dddb030ee6bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:06.324978 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-66b9e8fc-94e2-4ff0-b5ba-dddb030ee6bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.236907 Jun 15 14:45:06.335342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 180/352] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:06 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:07.343769 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-143728f3-57ed-4715-b218-0b9e2c55fb87 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:07.344466 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-143728f3-57ed-4715-b218-0b9e2c55fb87 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:07.352441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-143728f3-57ed-4715-b218-0b9e2c55fb87 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:07.352907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-143728f3-57ed-4715-b218-0b9e2c55fb87 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:07.354181 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-143728f3-57ed-4715-b218-0b9e2c55fb87 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:07.354520 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-143728f3-57ed-4715-b218-0b9e2c55fb87 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:07.529196 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-143728f3-57ed-4715-b218-0b9e2c55fb87 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:07.536921 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-143728f3-57ed-4715-b218-0b9e2c55fb87 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.197269 Jun 15 14:45:07.537633 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 173/353] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:07 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:08.554091 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-92c70c57-8495-41ba-8e25-048d8439d4cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:08.554849 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-92c70c57-8495-41ba-8e25-048d8439d4cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:08.562338 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-92c70c57-8495-41ba-8e25-048d8439d4cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:08.562820 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-92c70c57-8495-41ba-8e25-048d8439d4cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:08.563796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-92c70c57-8495-41ba-8e25-048d8439d4cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:08.564479 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-92c70c57-8495-41ba-8e25-048d8439d4cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:08.775180 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-92c70c57-8495-41ba-8e25-048d8439d4cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:08.784096 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-92c70c57-8495-41ba-8e25-048d8439d4cb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.234350 Jun 15 14:45:08.784713 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 181/354] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:08 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:09.801753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8d3d7be8-8b11-4f1d-862d-e817d4edc825 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:09.802688 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8d3d7be8-8b11-4f1d-862d-e817d4edc825 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:09.809412 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d3d7be8-8b11-4f1d-862d-e817d4edc825 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:09.809939 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d3d7be8-8b11-4f1d-862d-e817d4edc825 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:09.810913 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d3d7be8-8b11-4f1d-862d-e817d4edc825 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:09.811316 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d3d7be8-8b11-4f1d-862d-e817d4edc825 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:09.970976 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8d3d7be8-8b11-4f1d-862d-e817d4edc825 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:09.981192 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8d3d7be8-8b11-4f1d-862d-e817d4edc825 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.183197 Jun 15 14:45:09.997204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 174/355] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:09 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:11.015525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d7778e9d-c012-4e46-b923-f156611317d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:11.016337 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d7778e9d-c012-4e46-b923-f156611317d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:11.023785 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7778e9d-c012-4e46-b923-f156611317d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:11.024238 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7778e9d-c012-4e46-b923-f156611317d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:11.025015 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7778e9d-c012-4e46-b923-f156611317d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:11.025450 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7778e9d-c012-4e46-b923-f156611317d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:11.032268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:11.195368 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d7778e9d-c012-4e46-b923-f156611317d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:11.205054 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d7778e9d-c012-4e46-b923-f156611317d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.194259 Jun 15 14:45:11.216187 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 182/356] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:11 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:12.222295 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-03d0220c-9f2e-4a19-9190-9f87a1927f02 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:12.223064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-03d0220c-9f2e-4a19-9190-9f87a1927f02 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:12.234158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-03d0220c-9f2e-4a19-9190-9f87a1927f02 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:12.234909 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-03d0220c-9f2e-4a19-9190-9f87a1927f02 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:12.235870 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-03d0220c-9f2e-4a19-9190-9f87a1927f02 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:12.236469 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-03d0220c-9f2e-4a19-9190-9f87a1927f02 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:12.485236 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-03d0220c-9f2e-4a19-9190-9f87a1927f02 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:12.494249 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-03d0220c-9f2e-4a19-9190-9f87a1927f02 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.275881 Jun 15 14:45:12.495568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 175/357] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:12 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:13.512270 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-080b4624-f8b2-4f94-b6ac-d3b03ecd6d7b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:13.513510 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-080b4624-f8b2-4f94-b6ac-d3b03ecd6d7b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:13.520125 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:13.523159 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-080b4624-f8b2-4f94-b6ac-d3b03ecd6d7b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:13.524109 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-080b4624-f8b2-4f94-b6ac-d3b03ecd6d7b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:13.525532 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-080b4624-f8b2-4f94-b6ac-d3b03ecd6d7b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:13.526173 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-080b4624-f8b2-4f94-b6ac-d3b03ecd6d7b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:13.888395 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-080b4624-f8b2-4f94-b6ac-d3b03ecd6d7b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:13.905164 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-080b4624-f8b2-4f94-b6ac-d3b03ecd6d7b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.396554 Jun 15 14:45:13.906163 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 183/358] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:13 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:14.929212 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fc6a031a-f237-44e9-8c64-4ab57d17f90b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:14.931604 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fc6a031a-f237-44e9-8c64-4ab57d17f90b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:14.946202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6a031a-f237-44e9-8c64-4ab57d17f90b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:14.946809 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6a031a-f237-44e9-8c64-4ab57d17f90b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:14.948670 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6a031a-f237-44e9-8c64-4ab57d17f90b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:14.950111 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6a031a-f237-44e9-8c64-4ab57d17f90b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:15.116823 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc6a031a-f237-44e9-8c64-4ab57d17f90b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:15.127493 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fc6a031a-f237-44e9-8c64-4ab57d17f90b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.207205 Jun 15 14:45:15.128513 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 176/359] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:14 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:16.146967 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cb61c8b9-3ed9-40e7-b150-c36d168aa617 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:16.147758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cb61c8b9-3ed9-40e7-b150-c36d168aa617 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:16.156153 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cb61c8b9-3ed9-40e7-b150-c36d168aa617 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:16.156801 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cb61c8b9-3ed9-40e7-b150-c36d168aa617 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:16.157930 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cb61c8b9-3ed9-40e7-b150-c36d168aa617 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:16.158528 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cb61c8b9-3ed9-40e7-b150-c36d168aa617 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:16.353178 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cb61c8b9-3ed9-40e7-b150-c36d168aa617 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:16.362722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cb61c8b9-3ed9-40e7-b150-c36d168aa617 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.220090 Jun 15 14:45:16.364271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 184/360] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:16 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:17.382157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-502820fc-9785-4f42-8dcb-cc8bbf241ac6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:17.382966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-502820fc-9785-4f42-8dcb-cc8bbf241ac6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:17.385206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=50 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:17.391582 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-502820fc-9785-4f42-8dcb-cc8bbf241ac6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:17.392195 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-502820fc-9785-4f42-8dcb-cc8bbf241ac6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:17.392796 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-502820fc-9785-4f42-8dcb-cc8bbf241ac6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:17.393224 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-502820fc-9785-4f42-8dcb-cc8bbf241ac6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:17.630112 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-502820fc-9785-4f42-8dcb-cc8bbf241ac6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:17.638231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-502820fc-9785-4f42-8dcb-cc8bbf241ac6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.260794 Jun 15 14:45:17.638914 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 177/361] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:17 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:18.656941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9bc6bfdb-e385-472e-a9a8-0c157699e026 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:18.657572 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9bc6bfdb-e385-472e-a9a8-0c157699e026 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:18.664333 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bc6bfdb-e385-472e-a9a8-0c157699e026 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:18.664890 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bc6bfdb-e385-472e-a9a8-0c157699e026 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:18.665738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bc6bfdb-e385-472e-a9a8-0c157699e026 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:18.666249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9bc6bfdb-e385-472e-a9a8-0c157699e026 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:18.820834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9bc6bfdb-e385-472e-a9a8-0c157699e026 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:18.829810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9bc6bfdb-e385-472e-a9a8-0c157699e026 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.177159 Jun 15 14:45:18.830400 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 185/362] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:18 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:19.848538 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3a3fcba1-b29f-40ea-a718-5f70eb96fa72 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:19.850225 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3a3fcba1-b29f-40ea-a718-5f70eb96fa72 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:19.868433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3a3fcba1-b29f-40ea-a718-5f70eb96fa72 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:19.869288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3a3fcba1-b29f-40ea-a718-5f70eb96fa72 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:19.870741 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3a3fcba1-b29f-40ea-a718-5f70eb96fa72 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:19.871241 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3a3fcba1-b29f-40ea-a718-5f70eb96fa72 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:20.468941 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3a3fcba1-b29f-40ea-a718-5f70eb96fa72 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:20.501298 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3a3fcba1-b29f-40ea-a718-5f70eb96fa72 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.658177 Jun 15 14:45:20.501901 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 178/363] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:19 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:21.517732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e9460ca1-45cc-4a17-b912-41ac93d3ced7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:21.518355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e9460ca1-45cc-4a17-b912-41ac93d3ced7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:21.526714 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e9460ca1-45cc-4a17-b912-41ac93d3ced7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:21.527225 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e9460ca1-45cc-4a17-b912-41ac93d3ced7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:21.528018 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e9460ca1-45cc-4a17-b912-41ac93d3ced7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:21.528836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e9460ca1-45cc-4a17-b912-41ac93d3ced7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:21.864628 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e9460ca1-45cc-4a17-b912-41ac93d3ced7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:21.879044 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e9460ca1-45cc-4a17-b912-41ac93d3ced7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.364337 Jun 15 14:45:21.890754 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 186/364] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:21 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:22.902641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-60a0a162-74d5-415b-bd7b-f191ecae73eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:22.902641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-60a0a162-74d5-415b-bd7b-f191ecae73eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:22.905359 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-60a0a162-74d5-415b-bd7b-f191ecae73eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:22.905817 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-60a0a162-74d5-415b-bd7b-f191ecae73eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:22.907022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-60a0a162-74d5-415b-bd7b-f191ecae73eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:22.907466 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-60a0a162-74d5-415b-bd7b-f191ecae73eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:23.074966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-60a0a162-74d5-415b-bd7b-f191ecae73eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:23.086326 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-60a0a162-74d5-415b-bd7b-f191ecae73eb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.194164 Jun 15 14:45:23.087282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 179/365] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:22 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:23.181459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5c5bbaec-82f3-461f-a499-dc189c3947d1 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Action: 'create', calling method: .version_select at 0x7f05bc16e430>, body: {"keypair": {"name": "tempest-TestShelveInstance-576771872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSIrJxhmH9gs8I398kerA84ssRFsuv340NkTEC3aaUVpjgmiZNZrpYJju5gFbmw/TWVp9scFsflA2Dskc/KM9Cba28m8Wrs1FFRodGJvR+4nd+RiIwDNyVxjzjG11m+SQ=="}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:23.196360 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-5c5bbaec-82f3-461f-a499-dc189c3947d1 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Getting quotas for project 3e38db34f53b4271ab5462a872e954ef. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:45:23.200224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-5c5bbaec-82f3-461f-a499-dc189c3947d1 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Getting quotas for user 5d47f5d89bbb4d43844b1fb0794a3e69 and project 3e38db34f53b4271ab5462a872e954ef. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:45:23.225412 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5c5bbaec-82f3-461f-a499-dc189c3947d1 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.320203 Jun 15 14:45:23.226186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 187/366] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 14:45:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:24.105216 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4d96e73b-9b50-4a61-bed8-cab29ffb5333 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:24.105710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4d96e73b-9b50-4a61-bed8-cab29ffb5333 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:24.116890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d96e73b-9b50-4a61-bed8-cab29ffb5333 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.117819 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d96e73b-9b50-4a61-bed8-cab29ffb5333 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.119123 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d96e73b-9b50-4a61-bed8-cab29ffb5333 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.120071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d96e73b-9b50-4a61-bed8-cab29ffb5333 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.123846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:24.315070 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4d96e73b-9b50-4a61-bed8-cab29ffb5333 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:24.336163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4d96e73b-9b50-4a61-bed8-cab29ffb5333 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1502 microversion: 2.1 time: 0.235004 Jun 15 14:45:24.347222 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 180/367] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:24 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:24.356945 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "446bc527-6c4e-48b8-941a-ca11fb81e911"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:24.358057 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:24.367039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.367497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.368344 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.368843 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.397436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] HTTP exception thrown: Cannot 'attach_volume' instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 while it is in vm_state rescued Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Request method failure captured: Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: POST /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66/os-volume_attachments HTTP/1.1 Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 74 Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_vsVqv8zUDcLKMkhdoSOpO9htG3cYnqBij9rB1tU7ynIU2RsJHWW_IP3iTlvQft_XZa9z7dM3OLaNszoULmQUE0zyL6IuFGcqtfp3avZQMZBldLZHkPHo3rjPYQhcGCfpcRu9dAVIf-d0rmTUS3-vulsb_yBx9vHIMIetjdvoFbwA Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:45:24.399741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a243ba2c3f774c10b77a052075497b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: c9a3a2e49fee4ea08ca790006d0b29e4 Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {"volumeAttachment": {"volumeId": "446bc527-6c4e-48b8-941a-ca11fb81e911"}} Jun 15 14:45:24.401358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Cannot 'attach_volume' instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 while it is in vm_state rescued Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'server_id': 'c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66', 'body': {'volumeAttachment': {'volumeId': '446bc527-6c4e-48b8-941a-ca11fb81e911'}}} Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:45:24.402212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 while it is in vm_state rescued Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:45:24.403657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:45:24.404944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:45:24.404944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:45:24.404944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 while it is in vm_state rescued Jun 15 14:45:24.404944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:45:24.404944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Returning 409 to user: Cannot 'attach_volume' instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 while it is in vm_state rescued {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:45:24.404944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8e7b641a-dc18-4afa-8eae-c1f0732c0882 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048693 Jun 15 14:45:24.404944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 188/368] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:45:24 2022] POST /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 14:45:24.411998 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-57ef08a8-abec-4036-8d25-6c6906c25679 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:24.412832 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-57ef08a8-abec-4036-8d25-6c6906c25679 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:24.423478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57ef08a8-abec-4036-8d25-6c6906c25679 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.424161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57ef08a8-abec-4036-8d25-6c6906c25679 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.425614 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57ef08a8-abec-4036-8d25-6c6906c25679 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.426227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57ef08a8-abec-4036-8d25-6c6906c25679 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.538817 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-57ef08a8-abec-4036-8d25-6c6906c25679 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66/action" status: 202 len: 0 microversion: 2.1 time: 0.131577 Jun 15 14:45:24.540664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 181/369] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:45:24 2022] POST /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:45:24.549846 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6eb9d994-1354-4260-8179-b483187f0066 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:24.550630 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6eb9d994-1354-4260-8179-b483187f0066 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:24.558057 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6eb9d994-1354-4260-8179-b483187f0066 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.559168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6eb9d994-1354-4260-8179-b483187f0066 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.560189 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6eb9d994-1354-4260-8179-b483187f0066 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.560683 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6eb9d994-1354-4260-8179-b483187f0066 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.825053 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6eb9d994-1354-4260-8179-b483187f0066 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:24.838126 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6eb9d994-1354-4260-8179-b483187f0066 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1510 microversion: 2.1 time: 0.292526 Jun 15 14:45:24.841226 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 189/370] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:24 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:25.858031 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-991c92bd-59ff-470f-9ea0-89eea24c08b3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:25.858732 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-991c92bd-59ff-470f-9ea0-89eea24c08b3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:25.865856 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-991c92bd-59ff-470f-9ea0-89eea24c08b3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:25.866228 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-991c92bd-59ff-470f-9ea0-89eea24c08b3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:25.867026 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-991c92bd-59ff-470f-9ea0-89eea24c08b3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:25.867650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-991c92bd-59ff-470f-9ea0-89eea24c08b3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:26.043076 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-991c92bd-59ff-470f-9ea0-89eea24c08b3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:26.052485 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-991c92bd-59ff-470f-9ea0-89eea24c08b3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1510 microversion: 2.1 time: 0.199146 Jun 15 14:45:26.063067 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 182/371] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:25 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:27.094361 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f05b6bdc-0884-4725-a004-6d892b593752 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:27.096159 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f05b6bdc-0884-4725-a004-6d892b593752 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:27.113011 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f05b6bdc-0884-4725-a004-6d892b593752 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:27.113469 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f05b6bdc-0884-4725-a004-6d892b593752 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:27.114304 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f05b6bdc-0884-4725-a004-6d892b593752 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:27.116121 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f05b6bdc-0884-4725-a004-6d892b593752 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:27.329665 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f05b6bdc-0884-4725-a004-6d892b593752 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:27.339154 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f05b6bdc-0884-4725-a004-6d892b593752 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1510 microversion: 2.1 time: 0.272612 Jun 15 14:45:27.340248 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 190/372] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:27 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:28.358727 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-073c9575-5404-4e1f-b9d0-76905ab35357 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:28.359736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-073c9575-5404-4e1f-b9d0-76905ab35357 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:28.369030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-073c9575-5404-4e1f-b9d0-76905ab35357 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:28.369399 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-073c9575-5404-4e1f-b9d0-76905ab35357 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:28.370173 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-073c9575-5404-4e1f-b9d0-76905ab35357 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:28.370611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-073c9575-5404-4e1f-b9d0-76905ab35357 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:28.537515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-073c9575-5404-4e1f-b9d0-76905ab35357 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:28.545443 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-073c9575-5404-4e1f-b9d0-76905ab35357 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1510 microversion: 2.1 time: 0.190597 Jun 15 14:45:28.546019 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 183/373] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:28 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:29.570665 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d5bb43d6-6d44-4e82-a883-44c5672b61ce tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:29.571618 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d5bb43d6-6d44-4e82-a883-44c5672b61ce tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:29.578223 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d5bb43d6-6d44-4e82-a883-44c5672b61ce tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:29.578767 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d5bb43d6-6d44-4e82-a883-44c5672b61ce tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:29.579654 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d5bb43d6-6d44-4e82-a883-44c5672b61ce tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:29.580161 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d5bb43d6-6d44-4e82-a883-44c5672b61ce tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:29.747010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d5bb43d6-6d44-4e82-a883-44c5672b61ce tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:29.755588 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d5bb43d6-6d44-4e82-a883-44c5672b61ce tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1516 microversion: 2.1 time: 0.188848 Jun 15 14:45:29.756345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 191/374] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:29 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:36.402775 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bde698f3-1230-4eee-adb9-cad6cf2310bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'create', calling method: .version_select at 0x7f05bc470430>, body: {"keypair": {"name": "tempest-keypair-1038535616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfRXRU8Dui+x1JFFamrsvNNOicrvZimRL4HAxhpNBwLpKz18wg1HxudePMF8Zy5mP7NvtS36EFE3WFsen+8W68csUdoL9VlUEbrrb1HI1cHydmmeUVS0737bIb2Qyj7Mg=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:36.418587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-bde698f3-1230-4eee-adb9-cad6cf2310bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Getting quotas for project a243ba2c3f774c10b77a052075497b92. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:45:36.422396 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-bde698f3-1230-4eee-adb9-cad6cf2310bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Getting quotas for user c9a3a2e49fee4ea08ca790006d0b29e4 and project a243ba2c3f774c10b77a052075497b92. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:45:36.445103 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bde698f3-1230-4eee-adb9-cad6cf2310bb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046055 Jun 15 14:45:36.445691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 184/375] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 14:45:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:38.098423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1667748707", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d78101b2-2eb1-45aa-8dfb-f4f7bbd1e980"}], "security_groups": [{"name": "tempest-securitygroup--1181962779"}], "key_name": "tempest-keypair-1038535616", "user_data": "}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:38.105598 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=4 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:38.215223 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] validate_networks() for [('d78101b2-2eb1-45aa-8dfb-f4f7bbd1e980', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:45:38.624371 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:45:38.624793 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:45:38.625266 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:45:38.625706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:45:38.626130 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:45:38.637611 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:38.638128 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:38.638951 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:38.639527 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:38.657889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Getting quotas for project a243ba2c3f774c10b77a052075497b92. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:45:38.664630 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Getting quotas for user c9a3a2e49fee4ea08ca790006d0b29e4 and project a243ba2c3f774c10b77a052075497b92. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:45:38.676001 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:45:38.679728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:45:38.731042 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f72c2756-765f-4c2c-bbd6-bfb6ec08b25b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.636992 Jun 15 14:45:38.731536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 192/376] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:45:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:45:38.743035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e0d4eeb3-929e-40d1-8e28-31ca08f12bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:38.743792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e0d4eeb3-929e-40d1-8e28-31ca08f12bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:38.746218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:38.804139 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e0d4eeb3-929e-40d1-8e28-31ca08f12bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:38.811870 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e0d4eeb3-929e-40d1-8e28-31ca08f12bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1246 microversion: 2.1 time: 0.073796 Jun 15 14:45:38.812437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 185/377] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:38 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:39.830075 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4a722ee9-8fc6-4753-861e-830092f3f0fd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:39.830683 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4a722ee9-8fc6-4753-861e-830092f3f0fd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:39.837534 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4a722ee9-8fc6-4753-861e-830092f3f0fd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:39.838003 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4a722ee9-8fc6-4753-861e-830092f3f0fd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:39.838901 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4a722ee9-8fc6-4753-861e-830092f3f0fd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:39.839384 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4a722ee9-8fc6-4753-861e-830092f3f0fd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:39.930777 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4a722ee9-8fc6-4753-861e-830092f3f0fd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:39.941923 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4a722ee9-8fc6-4753-861e-830092f3f0fd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1306 microversion: 2.1 time: 0.115739 Jun 15 14:45:39.943302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 193/378] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:39 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1306 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:40.963324 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1f68638c-f029-43de-a539-89d1603c700b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:40.964014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1f68638c-f029-43de-a539-89d1603c700b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:40.972901 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f68638c-f029-43de-a539-89d1603c700b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.973765 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f68638c-f029-43de-a539-89d1603c700b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.974545 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f68638c-f029-43de-a539-89d1603c700b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.975140 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f68638c-f029-43de-a539-89d1603c700b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:41.230479 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1f68638c-f029-43de-a539-89d1603c700b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:41.242031 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1f68638c-f029-43de-a539-89d1603c700b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1372 microversion: 2.1 time: 0.284755 Jun 15 14:45:41.242610 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 186/379] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:40 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:41.634063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-2e38cfd2-fa35-4bbd-9848-fcf9c123bfb6 req-ab41c132-cccb-492b-a139-5aa89d8849b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fcc60c-8faa-4a1a-9932-9f2daeddaab1", "tag": "95ee574c-18c1-4dc1-ab0f-7028091804af"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:41.657305 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-2e38cfd2-fa35-4bbd-9848-fcf9c123bfb6 req-ab41c132-cccb-492b-a139-5aa89d8849b7 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:41.658057 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-2e38cfd2-fa35-4bbd-9848-fcf9c123bfb6 req-ab41c132-cccb-492b-a139-5aa89d8849b7 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:41.675425 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=60 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:41.678352 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-2e38cfd2-fa35-4bbd-9848-fcf9c123bfb6 req-ab41c132-cccb-492b-a139-5aa89d8849b7 service nova] Creating event network-changed:95ee574c-18c1-4dc1-ab0f-7028091804af for instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 on hv-cinder-80382 Jun 15 14:45:41.685608 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-2e38cfd2-fa35-4bbd-9848-fcf9c123bfb6 req-ab41c132-cccb-492b-a139-5aa89d8849b7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055338 Jun 15 14:45:41.686350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 194/380] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:42.263302 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-02d5b16f-5046-4058-b1b7-6abd87e5f73d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:42.263952 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-02d5b16f-5046-4058-b1b7-6abd87e5f73d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:42.274173 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-02d5b16f-5046-4058-b1b7-6abd87e5f73d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:42.274746 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-02d5b16f-5046-4058-b1b7-6abd87e5f73d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:42.275548 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-02d5b16f-5046-4058-b1b7-6abd87e5f73d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:42.275980 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-02d5b16f-5046-4058-b1b7-6abd87e5f73d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:42.466720 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-02d5b16f-5046-4058-b1b7-6abd87e5f73d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:42.475337 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-02d5b16f-5046-4058-b1b7-6abd87e5f73d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1372 microversion: 2.1 time: 0.217281 Jun 15 14:45:42.475940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 187/381] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:42 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:43.495020 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-57d1c48a-0b6e-461a-989b-d6491de2cb3d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:43.495977 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-57d1c48a-0b6e-461a-989b-d6491de2cb3d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:43.502605 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-57d1c48a-0b6e-461a-989b-d6491de2cb3d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:43.503081 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-57d1c48a-0b6e-461a-989b-d6491de2cb3d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:43.503977 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-57d1c48a-0b6e-461a-989b-d6491de2cb3d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:43.504422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-57d1c48a-0b6e-461a-989b-d6491de2cb3d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:43.653683 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-57d1c48a-0b6e-461a-989b-d6491de2cb3d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:43.664409 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-57d1c48a-0b6e-461a-989b-d6491de2cb3d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1372 microversion: 2.1 time: 0.174899 Jun 15 14:45:43.667250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 195/382] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:43 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:44.681687 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-266b30ec-cde9-4132-9e12-e1a2a953c317 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:44.682243 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-266b30ec-cde9-4132-9e12-e1a2a953c317 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:44.688701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-266b30ec-cde9-4132-9e12-e1a2a953c317 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.689149 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-266b30ec-cde9-4132-9e12-e1a2a953c317 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.689971 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-266b30ec-cde9-4132-9e12-e1a2a953c317 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.690410 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-266b30ec-cde9-4132-9e12-e1a2a953c317 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.841154 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-266b30ec-cde9-4132-9e12-e1a2a953c317 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:44.849583 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-266b30ec-cde9-4132-9e12-e1a2a953c317 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1372 microversion: 2.1 time: 0.171655 Jun 15 14:45:44.850767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 188/383] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:44 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:45.870663 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fb7134a3-362f-4140-8611-c2456e920a53 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:45.871303 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fb7134a3-362f-4140-8611-c2456e920a53 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:45.876987 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:45.889767 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fb7134a3-362f-4140-8611-c2456e920a53 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:45.890487 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fb7134a3-362f-4140-8611-c2456e920a53 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:45.891310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fb7134a3-362f-4140-8611-c2456e920a53 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:45.892088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fb7134a3-362f-4140-8611-c2456e920a53 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:46.155301 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fb7134a3-362f-4140-8611-c2456e920a53 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:46.164565 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fb7134a3-362f-4140-8611-c2456e920a53 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1372 microversion: 2.1 time: 0.300724 Jun 15 14:45:46.165157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 196/384] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:45 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1372 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:47.182961 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4bbcb059-35ae-4e9a-94d7-807cee4f0e4e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:47.183860 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4bbcb059-35ae-4e9a-94d7-807cee4f0e4e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:47.190277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bbcb059-35ae-4e9a-94d7-807cee4f0e4e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:47.190910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bbcb059-35ae-4e9a-94d7-807cee4f0e4e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:47.191729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bbcb059-35ae-4e9a-94d7-807cee4f0e4e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:47.192233 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bbcb059-35ae-4e9a-94d7-807cee4f0e4e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:47.337468 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4bbcb059-35ae-4e9a-94d7-807cee4f0e4e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:47.344736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4bbcb059-35ae-4e9a-94d7-807cee4f0e4e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1372 microversion: 2.1 time: 0.166191 Jun 15 14:45:47.345313 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 189/385] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:47 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:47.582941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-53dc5af5-18f4-4b34-bd8c-fced9ddcefd3 req-0a7a47a7-9d48-4343-a986-f17dd03f41fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fcc60c-8faa-4a1a-9932-9f2daeddaab1", "name": "network-vif-plugged", "status": "completed", "tag": "95ee574c-18c1-4dc1-ab0f-7028091804af"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:47.591276 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-53dc5af5-18f4-4b34-bd8c-fced9ddcefd3 req-0a7a47a7-9d48-4343-a986-f17dd03f41fc service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:47.591720 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-53dc5af5-18f4-4b34-bd8c-fced9ddcefd3 req-0a7a47a7-9d48-4343-a986-f17dd03f41fc service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:47.605972 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-53dc5af5-18f4-4b34-bd8c-fced9ddcefd3 req-0a7a47a7-9d48-4343-a986-f17dd03f41fc service nova] Creating event network-vif-plugged:95ee574c-18c1-4dc1-ab0f-7028091804af for instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 on hv-cinder-80382 Jun 15 14:45:47.611284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-53dc5af5-18f4-4b34-bd8c-fced9ddcefd3 req-0a7a47a7-9d48-4343-a986-f17dd03f41fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032369 Jun 15 14:45:47.612259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 197/386] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:48.362088 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5fdd1402-55e9-442c-887b-314fd3829721 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:48.362722 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5fdd1402-55e9-442c-887b-314fd3829721 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:48.365024 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:48.371242 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5fdd1402-55e9-442c-887b-314fd3829721 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:48.371716 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5fdd1402-55e9-442c-887b-314fd3829721 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:48.372522 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5fdd1402-55e9-442c-887b-314fd3829721 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:48.372960 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5fdd1402-55e9-442c-887b-314fd3829721 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:48.533440 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5fdd1402-55e9-442c-887b-314fd3829721 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:48.541395 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5fdd1402-55e9-442c-887b-314fd3829721 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1372 microversion: 2.1 time: 0.183450 Jun 15 14:45:48.541953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 190/387] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:48 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:49.556314 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:49.558078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:49.565958 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-14f45e06-ed0e-40ee-b45f-9d0edf3066d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:49.567097 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-14f45e06-ed0e-40ee-b45f-9d0edf3066d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:49.576704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-14f45e06-ed0e-40ee-b45f-9d0edf3066d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:49.577420 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-14f45e06-ed0e-40ee-b45f-9d0edf3066d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:49.578203 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-14f45e06-ed0e-40ee-b45f-9d0edf3066d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:49.578644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-14f45e06-ed0e-40ee-b45f-9d0edf3066d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:49.727407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-14f45e06-ed0e-40ee-b45f-9d0edf3066d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:49.734880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-14f45e06-ed0e-40ee-b45f-9d0edf3066d3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1372 microversion: 2.1 time: 0.180062 Jun 15 14:45:49.735475 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 198/388] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:49 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:50.753426 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d1125327-336c-4c80-97d7-e3fe57267970 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:50.754138 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d1125327-336c-4c80-97d7-e3fe57267970 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:50.756453 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:50.764084 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d1125327-336c-4c80-97d7-e3fe57267970 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.764683 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d1125327-336c-4c80-97d7-e3fe57267970 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.765747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d1125327-336c-4c80-97d7-e3fe57267970 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.766537 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d1125327-336c-4c80-97d7-e3fe57267970 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.906561 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d1125327-336c-4c80-97d7-e3fe57267970 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:50.915034 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d1125327-336c-4c80-97d7-e3fe57267970 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1567 microversion: 2.1 time: 0.165742 Jun 15 14:45:50.915604 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 191/389] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:50 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:50.931190 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4be8cdca-4cea-423a-8803-6cee048e307d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:50.931689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4be8cdca-4cea-423a-8803-6cee048e307d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:50.937595 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4be8cdca-4cea-423a-8803-6cee048e307d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.938043 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4be8cdca-4cea-423a-8803-6cee048e307d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.938805 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4be8cdca-4cea-423a-8803-6cee048e307d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.939264 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4be8cdca-4cea-423a-8803-6cee048e307d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:51.016948 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4be8cdca-4cea-423a-8803-6cee048e307d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089774 Jun 15 14:45:51.017600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 199/390] 10.222.0.45 () {58 vars in 1274 bytes} [Wed Jun 15 14:45:50 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:52.259450 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-cdfc4caa-df10-48c9-85a1-f08afd9286a3 req-5652730b-5d9c-4f05-ac3f-4fa90a6a8adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fcc60c-8faa-4a1a-9932-9f2daeddaab1", "tag": "95ee574c-18c1-4dc1-ab0f-7028091804af"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:52.270325 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-cdfc4caa-df10-48c9-85a1-f08afd9286a3 req-5652730b-5d9c-4f05-ac3f-4fa90a6a8adb service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:52.270984 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-cdfc4caa-df10-48c9-85a1-f08afd9286a3 req-5652730b-5d9c-4f05-ac3f-4fa90a6a8adb service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:52.284906 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-cdfc4caa-df10-48c9-85a1-f08afd9286a3 req-5652730b-5d9c-4f05-ac3f-4fa90a6a8adb service nova] Creating event network-changed:95ee574c-18c1-4dc1-ab0f-7028091804af for instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 on hv-cinder-80382 Jun 15 14:45:52.291436 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-cdfc4caa-df10-48c9-85a1-f08afd9286a3 req-5652730b-5d9c-4f05-ac3f-4fa90a6a8adb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036079 Jun 15 14:45:52.295641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 192/391] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:46:00.342350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-925324125", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-576771872", "security_groups": [{"name": "tempest-secgroup-smoke-1561097686"}], "networks": [{"uuid": "a1892718-4161-449a-b1ea-49a32d3d6cb1"}], "block_device_mapping_v2": [{"uuid": "12eaea20-bd55-4e62-8697-ba3da3e247b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:00.453897 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] validate_networks() for [('a1892718-4161-449a-b1ea-49a32d3d6cb1', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:46:00.816262 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:46:00.816630 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:46:00.817098 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:46:00.817499 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:46:00.817932 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:46:00.827560 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:00.828006 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:00.828803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:00.829239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:00.846400 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Getting quotas for project 3e38db34f53b4271ab5462a872e954ef. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:46:00.850336 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Getting quotas for user 5d47f5d89bbb4d43844b1fb0794a3e69 and project 3e38db34f53b4271ab5462a872e954ef. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:46:00.906251 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:46:00.908339 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12eaea20-bd55-4e62-8697-ba3da3e247b5',volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:46:01.037311 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c95e08ae-312d-413c-b936-7768f7454c90 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.699023 Jun 15 14:46:01.037874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 200/392] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:46:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:46:01.049957 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-76fffb00-3569-4b17-bb36-dcbf6e8a3e92 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:01.050660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-76fffb00-3569-4b17-bb36-dcbf6e8a3e92 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:01.104976 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-76fffb00-3569-4b17-bb36-dcbf6e8a3e92 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:01.111943 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-76fffb00-3569-4b17-bb36-dcbf6e8a3e92 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1087 microversion: 2.1 time: 0.066843 Jun 15 14:46:01.112522 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 193/393] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:01 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:02.129726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4822b8c0-8a9a-4c0a-ac21-bc9c7582bc4c tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:02.130329 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4822b8c0-8a9a-4c0a-ac21-bc9c7582bc4c tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:02.136644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4822b8c0-8a9a-4c0a-ac21-bc9c7582bc4c tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:02.137089 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4822b8c0-8a9a-4c0a-ac21-bc9c7582bc4c tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:02.137857 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4822b8c0-8a9a-4c0a-ac21-bc9c7582bc4c tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:02.138288 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4822b8c0-8a9a-4c0a-ac21-bc9c7582bc4c tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:02.204132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4822b8c0-8a9a-4c0a-ac21-bc9c7582bc4c tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:02.212349 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4822b8c0-8a9a-4c0a-ac21-bc9c7582bc4c tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1185 microversion: 2.1 time: 0.086468 Jun 15 14:46:02.212917 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 201/394] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:02 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:03.230786 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d255ed53-2c7f-4b0f-b9ae-9f6cb17201c5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:03.232151 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d255ed53-2c7f-4b0f-b9ae-9f6cb17201c5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:03.242790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=38 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:03.245774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d255ed53-2c7f-4b0f-b9ae-9f6cb17201c5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:03.246294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d255ed53-2c7f-4b0f-b9ae-9f6cb17201c5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:03.247387 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d255ed53-2c7f-4b0f-b9ae-9f6cb17201c5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:03.248242 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d255ed53-2c7f-4b0f-b9ae-9f6cb17201c5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:03.415329 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d255ed53-2c7f-4b0f-b9ae-9f6cb17201c5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:03.423581 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d255ed53-2c7f-4b0f-b9ae-9f6cb17201c5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1271 microversion: 2.1 time: 0.197546 Jun 15 14:46:03.424426 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 194/395] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:03 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:03.993453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-4c041cf5-0586-44c6-ba28-fa4d43ade967 req-265c262b-6b71-402d-9fe1-44f59c87fbfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c32b0d85-8788-4ac8-9e61-faee2f6abee5", "tag": "532f4749-40c3-4e35-839e-07bfc3d097bb"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:04.006027 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-4c041cf5-0586-44c6-ba28-fa4d43ade967 req-265c262b-6b71-402d-9fe1-44f59c87fbfe service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.006768 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-4c041cf5-0586-44c6-ba28-fa4d43ade967 req-265c262b-6b71-402d-9fe1-44f59c87fbfe service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.059288 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-4c041cf5-0586-44c6-ba28-fa4d43ade967 req-265c262b-6b71-402d-9fe1-44f59c87fbfe service nova] Creating event network-changed:532f4749-40c3-4e35-839e-07bfc3d097bb for instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 on hv-cinder-80382 Jun 15 14:46:04.065727 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-4c041cf5-0586-44c6-ba28-fa4d43ade967 req-265c262b-6b71-402d-9fe1-44f59c87fbfe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075867 Jun 15 14:46:04.067155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 202/396] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:04.441713 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3996dd25-5fc0-45fe-b423-5052d6d52f20 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:04.442261 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3996dd25-5fc0-45fe-b423-5052d6d52f20 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:04.449708 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3996dd25-5fc0-45fe-b423-5052d6d52f20 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.450193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3996dd25-5fc0-45fe-b423-5052d6d52f20 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.450974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3996dd25-5fc0-45fe-b423-5052d6d52f20 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.451436 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3996dd25-5fc0-45fe-b423-5052d6d52f20 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.589033 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3996dd25-5fc0-45fe-b423-5052d6d52f20 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:04.596715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3996dd25-5fc0-45fe-b423-5052d6d52f20 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.159074 Jun 15 14:46:04.597280 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 195/397] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:04 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:05.614752 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e4202782-c0bb-4c02-83c8-43e26f5a41ba tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:05.615487 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e4202782-c0bb-4c02-83c8-43e26f5a41ba tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:05.621956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e4202782-c0bb-4c02-83c8-43e26f5a41ba tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:05.622404 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e4202782-c0bb-4c02-83c8-43e26f5a41ba tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:05.623227 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e4202782-c0bb-4c02-83c8-43e26f5a41ba tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:05.623658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e4202782-c0bb-4c02-83c8-43e26f5a41ba tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:05.761461 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e4202782-c0bb-4c02-83c8-43e26f5a41ba tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:05.768981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e4202782-c0bb-4c02-83c8-43e26f5a41ba tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.158537 Jun 15 14:46:05.769546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 203/398] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:05 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:06.785924 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-21279ddc-e05f-42c9-93a4-f01231063a52 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:06.786532 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-21279ddc-e05f-42c9-93a4-f01231063a52 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:06.793801 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21279ddc-e05f-42c9-93a4-f01231063a52 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:06.794252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21279ddc-e05f-42c9-93a4-f01231063a52 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:06.795034 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21279ddc-e05f-42c9-93a4-f01231063a52 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:06.795501 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21279ddc-e05f-42c9-93a4-f01231063a52 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:06.924631 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-21279ddc-e05f-42c9-93a4-f01231063a52 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:06.932101 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-21279ddc-e05f-42c9-93a4-f01231063a52 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.150061 Jun 15 14:46:06.932660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 196/399] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:06 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:07.949122 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a2c99646-b40e-4456-aae5-a7c24dd48bd6 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:07.949721 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a2c99646-b40e-4456-aae5-a7c24dd48bd6 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:07.955714 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a2c99646-b40e-4456-aae5-a7c24dd48bd6 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:07.956158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a2c99646-b40e-4456-aae5-a7c24dd48bd6 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:07.956908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a2c99646-b40e-4456-aae5-a7c24dd48bd6 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:07.957338 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a2c99646-b40e-4456-aae5-a7c24dd48bd6 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:08.089977 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a2c99646-b40e-4456-aae5-a7c24dd48bd6 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:08.097356 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a2c99646-b40e-4456-aae5-a7c24dd48bd6 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.152582 Jun 15 14:46:08.097917 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 204/400] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:07 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:09.113813 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-76708076-bf3e-4cea-88df-3960a4156197 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:09.114461 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-76708076-bf3e-4cea-88df-3960a4156197 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:09.121009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-76708076-bf3e-4cea-88df-3960a4156197 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:09.121462 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-76708076-bf3e-4cea-88df-3960a4156197 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:09.122230 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-76708076-bf3e-4cea-88df-3960a4156197 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:09.122671 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-76708076-bf3e-4cea-88df-3960a4156197 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:09.254369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-76708076-bf3e-4cea-88df-3960a4156197 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:09.262343 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-76708076-bf3e-4cea-88df-3960a4156197 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.152519 Jun 15 14:46:09.262910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 197/401] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:09 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:10.278975 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0b06d5a4-e031-4051-9035-6e9396e4c46b tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:10.279812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0b06d5a4-e031-4051-9035-6e9396e4c46b tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:10.285914 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0b06d5a4-e031-4051-9035-6e9396e4c46b tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:10.286362 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0b06d5a4-e031-4051-9035-6e9396e4c46b tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:10.287225 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0b06d5a4-e031-4051-9035-6e9396e4c46b tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:10.287653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0b06d5a4-e031-4051-9035-6e9396e4c46b tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:10.418297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0b06d5a4-e031-4051-9035-6e9396e4c46b tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:10.425669 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0b06d5a4-e031-4051-9035-6e9396e4c46b tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.150622 Jun 15 14:46:10.426236 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 205/402] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:10 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:11.442371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2c2cd11a-f0bf-4c3b-9c28-d93de6784bcd tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:11.442985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2c2cd11a-f0bf-4c3b-9c28-d93de6784bcd tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:11.445346 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:11.450819 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c2cd11a-f0bf-4c3b-9c28-d93de6784bcd tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:11.451246 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c2cd11a-f0bf-4c3b-9c28-d93de6784bcd tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:11.452012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c2cd11a-f0bf-4c3b-9c28-d93de6784bcd tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:11.452452 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c2cd11a-f0bf-4c3b-9c28-d93de6784bcd tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:11.587061 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2c2cd11a-f0bf-4c3b-9c28-d93de6784bcd tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:11.594777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2c2cd11a-f0bf-4c3b-9c28-d93de6784bcd tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.156214 Jun 15 14:46:11.595385 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 198/403] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:11 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:12.612412 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6774146e-ea98-4b75-9508-5deedafb91d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:12.613126 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6774146e-ea98-4b75-9508-5deedafb91d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:12.614960 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:12.615877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:12.622969 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6774146e-ea98-4b75-9508-5deedafb91d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:12.623443 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6774146e-ea98-4b75-9508-5deedafb91d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:12.624198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6774146e-ea98-4b75-9508-5deedafb91d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:12.624649 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6774146e-ea98-4b75-9508-5deedafb91d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:12.762443 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6774146e-ea98-4b75-9508-5deedafb91d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:12.770969 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6774146e-ea98-4b75-9508-5deedafb91d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.162453 Jun 15 14:46:12.771551 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 206/404] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:12 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:13.788106 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2867010a-f4fb-40e7-b344-f86d02e111f7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:13.788706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2867010a-f4fb-40e7-b344-f86d02e111f7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:13.795247 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2867010a-f4fb-40e7-b344-f86d02e111f7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:13.795686 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2867010a-f4fb-40e7-b344-f86d02e111f7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:13.796593 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2867010a-f4fb-40e7-b344-f86d02e111f7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:13.797687 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2867010a-f4fb-40e7-b344-f86d02e111f7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:13.941061 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2867010a-f4fb-40e7-b344-f86d02e111f7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:13.950240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2867010a-f4fb-40e7-b344-f86d02e111f7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.165713 Jun 15 14:46:13.951082 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 199/405] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:13 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:14.967851 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5985418f-9025-41cc-b27f-f667e1778509 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:14.968686 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5985418f-9025-41cc-b27f-f667e1778509 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:14.975340 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5985418f-9025-41cc-b27f-f667e1778509 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:14.975802 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5985418f-9025-41cc-b27f-f667e1778509 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:14.976565 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5985418f-9025-41cc-b27f-f667e1778509 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:14.977718 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5985418f-9025-41cc-b27f-f667e1778509 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:14.981744 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=60 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:15.107896 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5985418f-9025-41cc-b27f-f667e1778509 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:15.115328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5985418f-9025-41cc-b27f-f667e1778509 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.151361 Jun 15 14:46:15.115880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 207/406] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:14 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:16.132075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-28c4be01-c475-4126-8e26-38f2b555a090 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:16.132668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-28c4be01-c475-4126-8e26-38f2b555a090 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:16.139596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-28c4be01-c475-4126-8e26-38f2b555a090 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:16.140044 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-28c4be01-c475-4126-8e26-38f2b555a090 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:16.140816 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-28c4be01-c475-4126-8e26-38f2b555a090 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:16.141243 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-28c4be01-c475-4126-8e26-38f2b555a090 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:16.274237 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-28c4be01-c475-4126-8e26-38f2b555a090 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:16.282094 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-28c4be01-c475-4126-8e26-38f2b555a090 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.153996 Jun 15 14:46:16.282655 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 200/407] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:16 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:17.299427 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a79a6607-318a-4502-a856-254fbcac3522 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:17.300029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a79a6607-318a-4502-a856-254fbcac3522 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:17.301907 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:17.307901 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a79a6607-318a-4502-a856-254fbcac3522 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:17.308343 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a79a6607-318a-4502-a856-254fbcac3522 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:17.309119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a79a6607-318a-4502-a856-254fbcac3522 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:17.309580 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a79a6607-318a-4502-a856-254fbcac3522 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:17.446074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a79a6607-318a-4502-a856-254fbcac3522 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:17.453389 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a79a6607-318a-4502-a856-254fbcac3522 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.157975 Jun 15 14:46:17.453950 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 208/408] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:17 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:17.876532 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-50cacf13-0ef0-4c41-9321-c264e5e6ac24 req-5635c9b4-ca4c-4213-9149-e4e0516780e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32b0d85-8788-4ac8-9e61-faee2f6abee5", "name": "network-vif-plugged", "status": "completed", "tag": "532f4749-40c3-4e35-839e-07bfc3d097bb"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:17.886069 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-50cacf13-0ef0-4c41-9321-c264e5e6ac24 req-5635c9b4-ca4c-4213-9149-e4e0516780e6 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:17.886616 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-50cacf13-0ef0-4c41-9321-c264e5e6ac24 req-5635c9b4-ca4c-4213-9149-e4e0516780e6 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:17.899790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-50cacf13-0ef0-4c41-9321-c264e5e6ac24 req-5635c9b4-ca4c-4213-9149-e4e0516780e6 service nova] Creating event network-vif-plugged:532f4749-40c3-4e35-839e-07bfc3d097bb for instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 on hv-cinder-80382 Jun 15 14:46:17.905229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-50cacf13-0ef0-4c41-9321-c264e5e6ac24 req-5635c9b4-ca4c-4213-9149-e4e0516780e6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032326 Jun 15 14:46:17.905817 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 201/409] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:18.469694 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-98859387-f793-4397-97fc-36831747ffbc tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:18.470295 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-98859387-f793-4397-97fc-36831747ffbc tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:18.476341 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-98859387-f793-4397-97fc-36831747ffbc tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:18.476859 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-98859387-f793-4397-97fc-36831747ffbc tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:18.478136 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-98859387-f793-4397-97fc-36831747ffbc tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:18.478565 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-98859387-f793-4397-97fc-36831747ffbc tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:18.615988 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-98859387-f793-4397-97fc-36831747ffbc tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:18.623322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-98859387-f793-4397-97fc-36831747ffbc tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.157471 Jun 15 14:46:18.623870 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 209/410] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:18 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:19.640720 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6138356a-ec65-456b-9a13-5a310dc822ef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:19.641444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6138356a-ec65-456b-9a13-5a310dc822ef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:19.643842 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=26 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:19.649543 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6138356a-ec65-456b-9a13-5a310dc822ef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:19.649988 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6138356a-ec65-456b-9a13-5a310dc822ef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:19.650771 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6138356a-ec65-456b-9a13-5a310dc822ef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:19.651218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6138356a-ec65-456b-9a13-5a310dc822ef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:19.802662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6138356a-ec65-456b-9a13-5a310dc822ef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:19.810454 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6138356a-ec65-456b-9a13-5a310dc822ef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1259 microversion: 2.1 time: 0.173871 Jun 15 14:46:19.811057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 202/411] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:19 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:20.826957 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-51b40d91-b481-4130-a113-5f259083afe3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:20.827632 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-51b40d91-b481-4130-a113-5f259083afe3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:20.834000 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-51b40d91-b481-4130-a113-5f259083afe3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:20.834440 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-51b40d91-b481-4130-a113-5f259083afe3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:20.835234 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-51b40d91-b481-4130-a113-5f259083afe3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:20.835689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-51b40d91-b481-4130-a113-5f259083afe3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:20.977546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-51b40d91-b481-4130-a113-5f259083afe3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:20.986309 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-51b40d91-b481-4130-a113-5f259083afe3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1443 microversion: 2.1 time: 0.163597 Jun 15 14:46:20.986797 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 210/412] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:20 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:21.002934 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a327c52-e94b-4dbc-b772-414e6648796e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:21.003567 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0a327c52-e94b-4dbc-b772-414e6648796e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:21.010509 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a327c52-e94b-4dbc-b772-414e6648796e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:21.011025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a327c52-e94b-4dbc-b772-414e6648796e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:21.011937 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a327c52-e94b-4dbc-b772-414e6648796e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:21.012444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a327c52-e94b-4dbc-b772-414e6648796e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:21.158080 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0a327c52-e94b-4dbc-b772-414e6648796e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:21.165768 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0a327c52-e94b-4dbc-b772-414e6648796e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1443 microversion: 2.1 time: 0.166609 Jun 15 14:46:21.166337 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 203/413] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:20 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1443 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:23.241224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-7da9c048-518d-40ac-a137-0fdf4af7e0d6 req-09cb6fdf-53ec-4bac-9814-478f505f378e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c32b0d85-8788-4ac8-9e61-faee2f6abee5", "tag": "532f4749-40c3-4e35-839e-07bfc3d097bb"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:23.249958 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-7da9c048-518d-40ac-a137-0fdf4af7e0d6 req-09cb6fdf-53ec-4bac-9814-478f505f378e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:23.250401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-7da9c048-518d-40ac-a137-0fdf4af7e0d6 req-09cb6fdf-53ec-4bac-9814-478f505f378e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:23.263297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-7da9c048-518d-40ac-a137-0fdf4af7e0d6 req-09cb6fdf-53ec-4bac-9814-478f505f378e service nova] Creating event network-changed:532f4749-40c3-4e35-839e-07bfc3d097bb for instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 on hv-cinder-80382 Jun 15 14:46:23.268941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-7da9c048-518d-40ac-a137-0fdf4af7e0d6 req-09cb6fdf-53ec-4bac-9814-478f505f378e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030940 Jun 15 14:46:23.269456 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 211/414] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:32.615134 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-de250301-6c47-4990-80c1-842758305c87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:32.615879 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-de250301-6c47-4990-80c1-842758305c87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:32.617704 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:32.618397 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=56 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:32.624141 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de250301-6c47-4990-80c1-842758305c87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.624595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de250301-6c47-4990-80c1-842758305c87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.625378 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de250301-6c47-4990-80c1-842758305c87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.625815 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de250301-6c47-4990-80c1-842758305c87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.651035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-de250301-6c47-4990-80c1-842758305c87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/ips" status: 200 len: 146 microversion: 2.1 time: 0.038785 Jun 15 14:46:32.651035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 204/415] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 14:46:32 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:36.387131 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=7 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:36.387880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=25 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:36.392648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c20844a7-697e-4206-be43-84c291fd24e5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cbf3e35-a5ec-4134-8116-6ccdb921a68e"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:36.393761 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c20844a7-697e-4206-be43-84c291fd24e5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:36.400782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c20844a7-697e-4206-be43-84c291fd24e5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:36.401233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c20844a7-697e-4206-be43-84c291fd24e5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:36.402002 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c20844a7-697e-4206-be43-84c291fd24e5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:36.402441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c20844a7-697e-4206-be43-84c291fd24e5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:36.493212 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-143a2869-e5ae-4455-881d-1da5a3a1cf58 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:36.494502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-143a2869-e5ae-4455-881d-1da5a3a1cf58 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:36.500446 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-143a2869-e5ae-4455-881d-1da5a3a1cf58 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:36.500901 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-143a2869-e5ae-4455-881d-1da5a3a1cf58 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:36.501703 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-143a2869-e5ae-4455-881d-1da5a3a1cf58 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:36.502154 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-143a2869-e5ae-4455-881d-1da5a3a1cf58 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:36.526800 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-143a2869-e5ae-4455-881d-1da5a3a1cf58 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/ips" status: 200 len: 151 microversion: 2.20 time: 0.037384 Jun 15 14:46:36.527409 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 205/416] 10.222.0.45 () {60 vars in 1288 bytes} [Wed Jun 15 14:46:36 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:46:36.731443 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c20844a7-697e-4206-be43-84c291fd24e5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344868 Jun 15 14:46:36.731815 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 212/417] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:46:36 2022] POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:40.127633 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-77b25c60-a0d2-478a-9177-480798867b60 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:40.128277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-77b25c60-a0d2-478a-9177-480798867b60 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:40.135311 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77b25c60-a0d2-478a-9177-480798867b60 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.135754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77b25c60-a0d2-478a-9177-480798867b60 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.136509 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77b25c60-a0d2-478a-9177-480798867b60 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.136946 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77b25c60-a0d2-478a-9177-480798867b60 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.166429 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-77b25c60-a0d2-478a-9177-480798867b60 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lazy-loading 'flavor' on Instance uuid 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:46:40.424619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-77b25c60-a0d2-478a-9177-480798867b60 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/action" status: 202 len: 0 microversion: 2.20 time: 0.300627 Jun 15 14:46:40.426428 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 206/418] 10.222.0.45 () {62 vars in 1318 bytes} [Wed Jun 15 14:46:40 2022] POST /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:46:40.435512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:40.436850 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:40.443931 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.444394 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.445207 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.445649 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.577886 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:40.585928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:40.587514 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:40.588714 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0271cf04-b9b8-45a6-8988-6f2bbd5633df tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.158739 Jun 15 14:46:40.589269 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 213/419] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:40 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:41.608958 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:41.609644 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:41.616502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.616955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.617740 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.618167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.754095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:41.762480 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:41.764003 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:41.765140 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-12836efc-b392-4728-acc1-c9f690e513f7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.161648 Jun 15 14:46:41.765695 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 207/420] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:41 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:42.783602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:42.784737 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:42.790980 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:42.791467 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:42.792745 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:42.793184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:42.938048 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:42.945977 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:42.947517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:42.948660 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-26dac5b7-fd01-471d-955a-32072bfb764d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.169424 Jun 15 14:46:42.949208 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 214/421] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:42 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:43.967448 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:43.968113 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:43.974618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.975094 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:43.975784 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.976214 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:44.109946 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:44.117738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:44.119263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:44.120503 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-22175554-0fe5-4df5-b98d-efdedf7bf878 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.157450 Jun 15 14:46:44.121052 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 208/422] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:43 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:45.139325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:45.139914 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:45.146601 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:45.147070 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:45.147843 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:45.148280 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:45.283913 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:45.291892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:45.293397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:45.294545 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4acbc65c-391c-41f9-9049-e3659e2713e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.159956 Jun 15 14:46:45.295153 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 215/423] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:45 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:46.314163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:46.315599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:46.324616 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.325346 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.326553 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.327227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.367561 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d823dfb2-0eef-48f5-9d95-becd45e1a7d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:46.374176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d823dfb2-0eef-48f5-9d95-becd45e1a7d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.374628 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d823dfb2-0eef-48f5-9d95-becd45e1a7d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.473672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.478702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d823dfb2-0eef-48f5-9d95-becd45e1a7d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Going to try to stop instance {{(pid=124178) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 14:46:46.486269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.488154 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.489410 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9b7716fa-2660-4544-baa9-2827a85edf3d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.179437 Jun 15 14:46:46.490078 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 209/424] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:46 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:46.531867 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d823dfb2-0eef-48f5-9d95-becd45e1a7d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/action" status: 202 len: 0 microversion: 2.1 time: 0.169313 Jun 15 14:46:46.536307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 216/425] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:46:46 2022] POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:46:46.541959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-973d44e6-30d0-4a41-84c8-10e6c34109e4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:46.542602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-973d44e6-30d0-4a41-84c8-10e6c34109e4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:46.549406 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-973d44e6-30d0-4a41-84c8-10e6c34109e4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.549993 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-973d44e6-30d0-4a41-84c8-10e6c34109e4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.550763 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-973d44e6-30d0-4a41-84c8-10e6c34109e4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.551495 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-973d44e6-30d0-4a41-84c8-10e6c34109e4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.686273 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-973d44e6-30d0-4a41-84c8-10e6c34109e4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.694507 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-973d44e6-30d0-4a41-84c8-10e6c34109e4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.156335 Jun 15 14:46:46.695104 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 210/426] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:46 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:47.512798 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:47.513616 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:47.520437 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.520877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.521690 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.522127 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.669848 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:47.678469 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:47.680008 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:47.681326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1e50245f-9d86-4bb7-b26b-7b5fecea1fbe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.173722 Jun 15 14:46:47.681890 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 217/427] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:47 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:47.713703 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b6780472-5f87-45f3-8a3e-7ec1067c7d9f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:47.714565 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b6780472-5f87-45f3-8a3e-7ec1067c7d9f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:47.721766 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6780472-5f87-45f3-8a3e-7ec1067c7d9f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.722247 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6780472-5f87-45f3-8a3e-7ec1067c7d9f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.723037 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6780472-5f87-45f3-8a3e-7ec1067c7d9f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.723671 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6780472-5f87-45f3-8a3e-7ec1067c7d9f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.870127 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b6780472-5f87-45f3-8a3e-7ec1067c7d9f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:47.878341 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b6780472-5f87-45f3-8a3e-7ec1067c7d9f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.169562 Jun 15 14:46:47.878910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 211/428] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:47 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:48.700855 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:48.701455 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:48.708047 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.708766 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:48.709647 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.710276 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:48.895815 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7026e67d-64f8-4286-b5e9-3c293d628616 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:48.896437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7026e67d-64f8-4286-b5e9-3c293d628616 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:48.899366 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:48.903894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7026e67d-64f8-4286-b5e9-3c293d628616 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.904344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7026e67d-64f8-4286-b5e9-3c293d628616 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:48.905119 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7026e67d-64f8-4286-b5e9-3c293d628616 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.905805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7026e67d-64f8-4286-b5e9-3c293d628616 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:48.908466 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:48.909972 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:48.911190 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c23b5e72-7045-4a8a-a950-27665880d492 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.214819 Jun 15 14:46:48.911758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 218/429] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:48 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:49.060100 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7026e67d-64f8-4286-b5e9-3c293d628616 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:49.069308 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7026e67d-64f8-4286-b5e9-3c293d628616 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.177485 Jun 15 14:46:49.070198 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 212/430] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:48 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:49.929480 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:49.930084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:49.937218 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:49.937673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:49.947164 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:49.947613 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.087299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a4f9cdee-665b-4da0-b28b-07766092b452 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:50.088019 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a4f9cdee-665b-4da0-b28b-07766092b452 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:50.094637 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4f9cdee-665b-4da0-b28b-07766092b452 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:50.095200 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4f9cdee-665b-4da0-b28b-07766092b452 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.095549 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.096300 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4f9cdee-665b-4da0-b28b-07766092b452 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:50.096806 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4f9cdee-665b-4da0-b28b-07766092b452 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.103496 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.105007 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.106239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5038da47-20ac-4494-8caf-0d022ab3576f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.180675 Jun 15 14:46:50.106799 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 219/431] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:49 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:50.228380 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a4f9cdee-665b-4da0-b28b-07766092b452 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.236921 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a4f9cdee-665b-4da0-b28b-07766092b452 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.153503 Jun 15 14:46:50.237497 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 213/432] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:50 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:51.125381 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:51.126011 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:51.134712 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.135692 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.137727 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.138425 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.254847 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-974dd39b-9ab0-437f-998a-38628a222fd2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:51.256289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-974dd39b-9ab0-437f-998a-38628a222fd2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:51.264172 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-974dd39b-9ab0-437f-998a-38628a222fd2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.264613 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-974dd39b-9ab0-437f-998a-38628a222fd2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.265381 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-974dd39b-9ab0-437f-998a-38628a222fd2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.265811 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-974dd39b-9ab0-437f-998a-38628a222fd2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.279131 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:51.287211 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:51.288716 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:51.289857 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-52b8aa28-dd33-4114-8cf7-a0ff38dffa83 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.168992 Jun 15 14:46:51.290417 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 220/433] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:51 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:51.399341 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-974dd39b-9ab0-437f-998a-38628a222fd2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:51.407582 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-974dd39b-9ab0-437f-998a-38628a222fd2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.157520 Jun 15 14:46:51.408152 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 214/434] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:51 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:52.307988 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:52.308585 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:52.315186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.315475 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.316224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.316651 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.424520 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8d3fc831-4302-40e5-a7b7-81aff2d7a4d0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:52.425123 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8d3fc831-4302-40e5-a7b7-81aff2d7a4d0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:52.431866 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d3fc831-4302-40e5-a7b7-81aff2d7a4d0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.432357 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d3fc831-4302-40e5-a7b7-81aff2d7a4d0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.433076 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d3fc831-4302-40e5-a7b7-81aff2d7a4d0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.433499 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d3fc831-4302-40e5-a7b7-81aff2d7a4d0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.445301 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.453659 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.455194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.456623 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-135e66df-919a-4d44-aa98-6b8876deafea tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.152507 Jun 15 14:46:52.457184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 221/435] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:52 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:52.563826 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8d3fc831-4302-40e5-a7b7-81aff2d7a4d0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.571675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8d3fc831-4302-40e5-a7b7-81aff2d7a4d0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.151009 Jun 15 14:46:52.572234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 215/436] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:52 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:53.475451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:53.476058 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:53.482506 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.482960 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.483764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.484203 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.588711 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9b114cef-19b9-4618-af2a-aa4b160f3a16 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:53.589320 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9b114cef-19b9-4618-af2a-aa4b160f3a16 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:53.595695 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b114cef-19b9-4618-af2a-aa4b160f3a16 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.596139 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b114cef-19b9-4618-af2a-aa4b160f3a16 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.596897 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b114cef-19b9-4618-af2a-aa4b160f3a16 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.597327 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b114cef-19b9-4618-af2a-aa4b160f3a16 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.611357 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:53.619427 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:53.620953 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:53.622865 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fb698514-104c-48be-ba81-81690e1a1160 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.151299 Jun 15 14:46:53.623465 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 222/437] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:53 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:53.725104 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9b114cef-19b9-4618-af2a-aa4b160f3a16 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:53.734266 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9b114cef-19b9-4618-af2a-aa4b160f3a16 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.148896 Jun 15 14:46:53.734379 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 216/438] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:53 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:54.641514 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:54.642119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:54.648569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.649015 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.649772 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.650203 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.751151 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-044c4931-bae1-4bfb-afaf-3eef1debb525 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:54.751784 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-044c4931-bae1-4bfb-afaf-3eef1debb525 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:54.758770 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-044c4931-bae1-4bfb-afaf-3eef1debb525 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.759239 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-044c4931-bae1-4bfb-afaf-3eef1debb525 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.760003 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-044c4931-bae1-4bfb-afaf-3eef1debb525 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.760438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-044c4931-bae1-4bfb-afaf-3eef1debb525 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.783060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.791078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.792572 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.793716 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-efccb93d-d6e6-420f-9e65-04f5f399b95a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.156692 Jun 15 14:46:54.794271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 223/439] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:54 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:54.899665 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-044c4931-bae1-4bfb-afaf-3eef1debb525 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.907827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-044c4931-bae1-4bfb-afaf-3eef1debb525 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.161036 Jun 15 14:46:54.908392 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 217/440] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:54 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:55.812838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:55.813439 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:55.820391 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.820843 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.821603 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.822039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.924715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d98553b4-0a57-4387-8aa1-6d8d06d82c32 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:55.925315 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d98553b4-0a57-4387-8aa1-6d8d06d82c32 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:55.931795 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d98553b4-0a57-4387-8aa1-6d8d06d82c32 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.932236 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d98553b4-0a57-4387-8aa1-6d8d06d82c32 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.933021 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d98553b4-0a57-4387-8aa1-6d8d06d82c32 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.933450 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d98553b4-0a57-4387-8aa1-6d8d06d82c32 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.955571 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:55.963317 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:55.964807 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:55.966586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3fe6cd86-41bd-496b-9cba-ac0d31ae4bb1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.157912 Jun 15 14:46:55.973224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 224/441] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:55 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:56.061455 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d98553b4-0a57-4387-8aa1-6d8d06d82c32 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:56.069289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d98553b4-0a57-4387-8aa1-6d8d06d82c32 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.148326 Jun 15 14:46:56.069859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 218/442] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:55 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:56.985145 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:56.985702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:56.993088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.993537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.994306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.994738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.087176 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-99af28c6-b179-4984-b1fb-a77c293c94f3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:57.087902 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-99af28c6-b179-4984-b1fb-a77c293c94f3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:57.094934 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99af28c6-b179-4984-b1fb-a77c293c94f3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.095425 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99af28c6-b179-4984-b1fb-a77c293c94f3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.096167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99af28c6-b179-4984-b1fb-a77c293c94f3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.096597 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99af28c6-b179-4984-b1fb-a77c293c94f3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.101160 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:57.159481 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.168094 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.170206 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.171403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-30bcd630-d8cb-46bc-b8a6-c1dcaba8746b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.190719 Jun 15 14:46:57.172689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 225/443] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:56 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:57.255327 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-99af28c6-b179-4984-b1fb-a77c293c94f3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.265273 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-99af28c6-b179-4984-b1fb-a77c293c94f3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.182302 Jun 15 14:46:57.265869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 219/444] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:57 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:58.191412 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:58.192014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:58.198653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.199336 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.200115 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.200554 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.205323 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:58.282396 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-394a39b0-c674-4508-9acf-473db6c010de tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:58.283021 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-394a39b0-c674-4508-9acf-473db6c010de tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:58.289663 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-394a39b0-c674-4508-9acf-473db6c010de tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.290114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-394a39b0-c674-4508-9acf-473db6c010de tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.290878 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-394a39b0-c674-4508-9acf-473db6c010de tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.291349 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-394a39b0-c674-4508-9acf-473db6c010de tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.346513 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:58.362646 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:58.364216 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:58.365402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2ffd3aad-d5c1-4f18-8d3a-f5f26b7e0bf9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.177991 Jun 15 14:46:58.366119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 226/445] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:58 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:58.433644 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-394a39b0-c674-4508-9acf-473db6c010de tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:58.442607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-394a39b0-c674-4508-9acf-473db6c010de tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.164730 Jun 15 14:46:58.443150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 220/446] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:58 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:59.384117 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:59.384729 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:59.391883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.392338 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.393104 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.393544 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.459851 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d4c63576-095b-423d-b8ed-07113557052f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:59.460459 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d4c63576-095b-423d-b8ed-07113557052f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:59.466885 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4c63576-095b-423d-b8ed-07113557052f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.467363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4c63576-095b-423d-b8ed-07113557052f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.468132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4c63576-095b-423d-b8ed-07113557052f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.468564 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4c63576-095b-423d-b8ed-07113557052f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.549158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:59.557150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:59.558676 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:59.559863 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-28aad971-f8d7-44f7-a97b-dc2d3529404b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.179668 Jun 15 14:46:59.560947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 227/447] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:59 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:59.614950 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d4c63576-095b-423d-b8ed-07113557052f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:59.623693 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d4c63576-095b-423d-b8ed-07113557052f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.167100 Jun 15 14:46:59.624267 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 221/448] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:59 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:00.579214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:00.579853 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:00.586540 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.587012 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.587781 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.588220 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.641144 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-01a79c05-a946-4d5e-bf32-3e2d7e977ca3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:00.641753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-01a79c05-a946-4d5e-bf32-3e2d7e977ca3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:00.648605 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01a79c05-a946-4d5e-bf32-3e2d7e977ca3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.649054 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01a79c05-a946-4d5e-bf32-3e2d7e977ca3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.650056 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01a79c05-a946-4d5e-bf32-3e2d7e977ca3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.650499 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01a79c05-a946-4d5e-bf32-3e2d7e977ca3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.757211 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.766762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.768313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.769482 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3314c496-bc5d-44d2-ae2f-d629b80fe1e8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.194774 Jun 15 14:47:00.778437 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 228/449] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:00 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:00.804247 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-01a79c05-a946-4d5e-bf32-3e2d7e977ca3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.813441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-01a79c05-a946-4d5e-bf32-3e2d7e977ca3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.176620 Jun 15 14:47:00.814009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 222/450] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:00 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:01.788215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:01.788820 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:01.796011 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.796456 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.797213 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.797650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.830214 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9d3aa676-3d6d-4a18-9410-7c42f7eb6939 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:01.830903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9d3aa676-3d6d-4a18-9410-7c42f7eb6939 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:01.837309 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9d3aa676-3d6d-4a18-9410-7c42f7eb6939 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.837749 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9d3aa676-3d6d-4a18-9410-7c42f7eb6939 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.838508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9d3aa676-3d6d-4a18-9410-7c42f7eb6939 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.838940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9d3aa676-3d6d-4a18-9410-7c42f7eb6939 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.975439 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:01.983364 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:01.984974 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:01.986224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-828130e3-83e0-4727-937e-c23046a8665b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.202026 Jun 15 14:47:01.986861 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 229/451] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:01 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:02.003523 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9d3aa676-3d6d-4a18-9410-7c42f7eb6939 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:02.011276 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9d3aa676-3d6d-4a18-9410-7c42f7eb6939 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.185492 Jun 15 14:47:02.011832 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 223/452] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:01 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:03.004762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:03.005312 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:03.011708 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:03.012157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.012910 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:03.013369 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.028054 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-23fcdd4c-199f-40e4-aaf5-e517441f0fe1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:03.028664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-23fcdd4c-199f-40e4-aaf5-e517441f0fe1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:03.031863 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=41 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:03.037202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-23fcdd4c-199f-40e4-aaf5-e517441f0fe1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:03.037653 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-23fcdd4c-199f-40e4-aaf5-e517441f0fe1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.038424 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-23fcdd4c-199f-40e4-aaf5-e517441f0fe1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:03.038860 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-23fcdd4c-199f-40e4-aaf5-e517441f0fe1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.213067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:03.220371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-23fcdd4c-199f-40e4-aaf5-e517441f0fe1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:03.221584 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:03.223135 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:03.224420 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-de869ca1-e88a-4692-a9e5-cfbc3be99ce3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.223655 Jun 15 14:47:03.225116 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 230/453] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:02 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:03.229554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-23fcdd4c-199f-40e4-aaf5-e517441f0fe1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.205240 Jun 15 14:47:03.230113 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 224/454] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:03 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:04.243121 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:04.243718 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:04.246758 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-34ca43f2-80f0-4118-a4ec-a2d8b458f36f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:04.248559 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-34ca43f2-80f0-4118-a4ec-a2d8b458f36f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:04.251189 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.251638 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:04.252396 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.252825 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:04.254965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-34ca43f2-80f0-4118-a4ec-a2d8b458f36f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.255442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-34ca43f2-80f0-4118-a4ec-a2d8b458f36f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:04.256272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-34ca43f2-80f0-4118-a4ec-a2d8b458f36f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.257984 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-34ca43f2-80f0-4118-a4ec-a2d8b458f36f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:04.448897 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-34ca43f2-80f0-4118-a4ec-a2d8b458f36f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:04.452155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:04.456957 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-34ca43f2-80f0-4118-a4ec-a2d8b458f36f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.213903 Jun 15 14:47:04.457526 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 225/455] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:04 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:04.460182 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:04.461686 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:04.462822 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-62e9c10d-fc18-435e-8108-5fa3eb8b3ab7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1743 microversion: 2.20 time: 0.223612 Jun 15 14:47:04.463419 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 231/456] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:04 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:05.474976 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d359ebd5-0282-4a48-aa75-e08fdb23c149 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:05.475629 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d359ebd5-0282-4a48-aa75-e08fdb23c149 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:05.480760 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:05.481370 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:05.482209 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-0282-4a48-aa75-e08fdb23c149 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:05.482653 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-0282-4a48-aa75-e08fdb23c149 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:05.483437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-0282-4a48-aa75-e08fdb23c149 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:05.483873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-0282-4a48-aa75-e08fdb23c149 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:05.487798 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:05.488249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:05.489016 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:05.489453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:05.677773 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d359ebd5-0282-4a48-aa75-e08fdb23c149 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:05.681369 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:05.686613 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d359ebd5-0282-4a48-aa75-e08fdb23c149 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.215236 Jun 15 14:47:05.687628 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 226/457] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:05 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:05.689882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:05.691440 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:05.692592 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-63553189-855b-437f-a195-d4f29fb618fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1743 microversion: 2.20 time: 0.215689 Jun 15 14:47:05.693568 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 232/458] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:05 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1743 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:06.704465 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9c20e76d-9da1-428b-bd7b-dbab0c9ccaa7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:06.705216 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9c20e76d-9da1-428b-bd7b-dbab0c9ccaa7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:06.710574 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:06.711211 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:06.712323 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9c20e76d-9da1-428b-bd7b-dbab0c9ccaa7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.712780 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9c20e76d-9da1-428b-bd7b-dbab0c9ccaa7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:06.713554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9c20e76d-9da1-428b-bd7b-dbab0c9ccaa7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.713990 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9c20e76d-9da1-428b-bd7b-dbab0c9ccaa7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:06.716223 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=43 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:06.718887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.719401 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:06.720169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.720602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:06.914465 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9c20e76d-9da1-428b-bd7b-dbab0c9ccaa7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:06.917439 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:06.923721 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9c20e76d-9da1-428b-bd7b-dbab0c9ccaa7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.223615 Jun 15 14:47:06.924550 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 227/459] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:06 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:06.925986 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:06.927516 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:06.928662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cd56d01d-bcaf-4fef-83b8-541857b5a56d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1743 microversion: 2.20 time: 0.221826 Jun 15 14:47:06.929383 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 233/460] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:06 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1743 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:07.941399 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ec179be7-0dbf-4170-bfa9-fcf7df29f8e3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:07.941977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ec179be7-0dbf-4170-bfa9-fcf7df29f8e3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:07.946878 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:07.947523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:07.948429 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec179be7-0dbf-4170-bfa9-fcf7df29f8e3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:07.948885 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec179be7-0dbf-4170-bfa9-fcf7df29f8e3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:07.949657 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec179be7-0dbf-4170-bfa9-fcf7df29f8e3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:07.950099 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec179be7-0dbf-4170-bfa9-fcf7df29f8e3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:07.954797 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:07.955264 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:07.956167 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:07.956611 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:08.148396 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ec179be7-0dbf-4170-bfa9-fcf7df29f8e3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:08.151465 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:08.156692 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ec179be7-0dbf-4170-bfa9-fcf7df29f8e3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.219357 Jun 15 14:47:08.157265 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 228/461] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:07 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:08.159774 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:08.161282 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:08.162425 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f6515abd-4a43-4559-80c3-255b7be8be1b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1743 microversion: 2.20 time: 0.219923 Jun 15 14:47:08.162968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 234/462] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:07 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:09.145599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-6f61027c-f5b0-4687-a64b-5e19b139421b req-90bbcdf8-d0db-472f-9cfe-009e21fd606a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75215a3c-bc0f-4e8b-9c52-a35946a5bfb1", "name": "network-vif-plugged", "status": "completed", "tag": "e62eb4f5-3c82-41c8-bbba-4140a119e597"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:09.155198 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-6f61027c-f5b0-4687-a64b-5e19b139421b req-90bbcdf8-d0db-472f-9cfe-009e21fd606a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.155721 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-6f61027c-f5b0-4687-a64b-5e19b139421b req-90bbcdf8-d0db-472f-9cfe-009e21fd606a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.170714 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-6f61027c-f5b0-4687-a64b-5e19b139421b req-90bbcdf8-d0db-472f-9cfe-009e21fd606a service nova] Creating event network-vif-plugged:e62eb4f5-3c82-41c8-bbba-4140a119e597 for instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 on hv-cinder-80382 Jun 15 14:47:09.174048 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c1e837c9-81bc-4bd7-b33d-9b7a2c92c952 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:09.174902 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c1e837c9-81bc-4bd7-b33d-9b7a2c92c952 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:09.176992 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-6f61027c-f5b0-4687-a64b-5e19b139421b req-90bbcdf8-d0db-472f-9cfe-009e21fd606a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035240 Jun 15 14:47:09.178310 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 229/463] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:47:09.183629 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:09.184501 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:09.192495 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.192944 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.193652 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c1e837c9-81bc-4bd7-b33d-9b7a2c92c952 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.193780 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.194121 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.194611 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c1e837c9-81bc-4bd7-b33d-9b7a2c92c952 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.197504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c1e837c9-81bc-4bd7-b33d-9b7a2c92c952 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.200076 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c1e837c9-81bc-4bd7-b33d-9b7a2c92c952 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.399849 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:09.404642 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c1e837c9-81bc-4bd7-b33d-9b7a2c92c952 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:09.408732 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:09.410248 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:09.411435 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-21a7b6e3-1fb9-422e-b8b4-427c40022437 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1743 microversion: 2.20 time: 0.231726 Jun 15 14:47:09.411995 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 230/464] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:09 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1743 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:09.413648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c1e837c9-81bc-4bd7-b33d-9b7a2c92c952 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.243942 Jun 15 14:47:09.414333 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 235/465] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:09 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:10.429579 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:10.430147 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fef53840-4bb5-4bed-9f83-3c5c943a7eb2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:10.430500 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:10.430612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fef53840-4bb5-4bed-9f83-3c5c943a7eb2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:10.436700 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:10.437147 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fef53840-4bb5-4bed-9f83-3c5c943a7eb2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:10.437247 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:10.437603 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fef53840-4bb5-4bed-9f83-3c5c943a7eb2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:10.437907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:10.438344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:10.438445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fef53840-4bb5-4bed-9f83-3c5c943a7eb2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:10.438793 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fef53840-4bb5-4bed-9f83-3c5c943a7eb2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:10.627014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fef53840-4bb5-4bed-9f83-3c5c943a7eb2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:10.633742 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:10.635124 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fef53840-4bb5-4bed-9f83-3c5c943a7eb2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.208876 Jun 15 14:47:10.635892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 236/466] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:10 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:10.642526 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:10.644230 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:10.645372 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f20b90d5-832d-4ab1-a9cf-e256348611e9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1743 microversion: 2.20 time: 0.219720 Jun 15 14:47:10.645914 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 231/467] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:10 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:11.652616 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f7d48367-4586-4191-adf6-c38755f0ac5d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:11.653227 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f7d48367-4586-4191-adf6-c38755f0ac5d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:11.660835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f7d48367-4586-4191-adf6-c38755f0ac5d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.661289 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f7d48367-4586-4191-adf6-c38755f0ac5d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.662062 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f7d48367-4586-4191-adf6-c38755f0ac5d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.662505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f7d48367-4586-4191-adf6-c38755f0ac5d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.662938 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:11.663582 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:11.670075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.670519 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.671306 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.671735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.851347 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f7d48367-4586-4191-adf6-c38755f0ac5d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:11.858060 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:11.859352 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f7d48367-4586-4191-adf6-c38755f0ac5d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.210538 Jun 15 14:47:11.859998 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 237/468] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:11 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:11.866164 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:11.867773 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:11.868929 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0a25494d-a20b-4bcf-a11d-caa050634bbb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1743 microversion: 2.20 time: 0.209752 Jun 15 14:47:11.869478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 232/469] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:11 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1743 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:12.876506 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2c40fa8d-f1aa-4f6f-8651-0085711841d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:12.877119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2c40fa8d-f1aa-4f6f-8651-0085711841d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:12.883670 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2c40fa8d-f1aa-4f6f-8651-0085711841d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.884118 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2c40fa8d-f1aa-4f6f-8651-0085711841d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:12.884871 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2c40fa8d-f1aa-4f6f-8651-0085711841d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.885300 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2c40fa8d-f1aa-4f6f-8651-0085711841d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:12.887289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:12.887893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:12.895096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.895586 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:12.896692 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.897430 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:13.095685 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2c40fa8d-f1aa-4f6f-8651-0085711841d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.103965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.106674 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2c40fa8d-f1aa-4f6f-8651-0085711841d2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1723 microversion: 2.1 time: 0.233469 Jun 15 14:47:13.107686 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 238/470] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:12 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:13.121441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.122963 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.124216 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-33045494-8bb0-4f19-b45d-a62e1153794f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1743 microversion: 2.20 time: 0.240875 Jun 15 14:47:13.124774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 233/471] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:12 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1743 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:14.123810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9d1b9c32-8d0e-4e25-a4a9-5d61b8278bb8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:14.125548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9d1b9c32-8d0e-4e25-a4a9-5d61b8278bb8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:14.132994 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d1b9c32-8d0e-4e25-a4a9-5d61b8278bb8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.133575 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d1b9c32-8d0e-4e25-a4a9-5d61b8278bb8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.134375 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d1b9c32-8d0e-4e25-a4a9-5d61b8278bb8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.134969 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d1b9c32-8d0e-4e25-a4a9-5d61b8278bb8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.146029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:14.147220 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:14.153985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.154635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.155685 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.156536 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.347956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9d1b9c32-8d0e-4e25-a4a9-5d61b8278bb8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:14.368029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9d1b9c32-8d0e-4e25-a4a9-5d61b8278bb8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1700 microversion: 2.1 time: 0.247995 Jun 15 14:47:14.379314 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 239/472] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:14 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1700 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:14.379437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:14.385294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:14.386407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-22a01f5a-66dc-4d2a-9496-cc4070c5b4fd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:14.387414 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:14.388936 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e1ec515b-dbc9-41fa-beb9-71d9f511f547 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1738 microversion: 2.20 time: 0.247238 Jun 15 14:47:14.390081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 234/473] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:14 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:14.393105 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22a01f5a-66dc-4d2a-9496-cc4070c5b4fd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.393652 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22a01f5a-66dc-4d2a-9496-cc4070c5b4fd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.422065 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-22a01f5a-66dc-4d2a-9496-cc4070c5b4fd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Going to try to start instance {{(pid=124178) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 14:47:14.472374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-22a01f5a-66dc-4d2a-9496-cc4070c5b4fd tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/action" status: 202 len: 0 microversion: 2.1 time: 0.090451 Jun 15 14:47:14.473890 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 240/474] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:47:14 2022] POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:47:14.482098 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c3f4f974-8057-4069-a4ec-7299be03248d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:14.482724 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c3f4f974-8057-4069-a4ec-7299be03248d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:14.490336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c3f4f974-8057-4069-a4ec-7299be03248d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.490800 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c3f4f974-8057-4069-a4ec-7299be03248d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.491745 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c3f4f974-8057-4069-a4ec-7299be03248d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.492186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c3f4f974-8057-4069-a4ec-7299be03248d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.665461 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c3f4f974-8057-4069-a4ec-7299be03248d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:14.676622 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c3f4f974-8057-4069-a4ec-7299be03248d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1709 microversion: 2.1 time: 0.198353 Jun 15 14:47:14.688198 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 235/475] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:14 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1709 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:15.409963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:15.411732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:15.418565 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:15.419141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:15.420363 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:15.421534 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:15.628850 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:15.632361 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:15.638550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:15.640116 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:15.641685 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d7ff9950-a7a9-495d-ac86-05592b54791b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1738 microversion: 2.20 time: 0.237710 Jun 15 14:47:15.642249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 241/476] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:15 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:15.694314 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-17c63527-ae3d-4a5f-8314-ff57efa7b316 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:15.695594 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-17c63527-ae3d-4a5f-8314-ff57efa7b316 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:15.702673 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17c63527-ae3d-4a5f-8314-ff57efa7b316 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:15.703156 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17c63527-ae3d-4a5f-8314-ff57efa7b316 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:15.703935 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17c63527-ae3d-4a5f-8314-ff57efa7b316 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:15.704370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17c63527-ae3d-4a5f-8314-ff57efa7b316 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:15.725268 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:15.864043 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-17c63527-ae3d-4a5f-8314-ff57efa7b316 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:15.872433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-17c63527-ae3d-4a5f-8314-ff57efa7b316 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1709 microversion: 2.1 time: 0.182093 Jun 15 14:47:15.873013 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 236/477] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:15 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1709 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:16.668508 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:16.670239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:16.678012 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:16.678808 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:16.680013 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:16.680462 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:16.832346 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:16.844085 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:16.845908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:16.847861 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-70654040-9056-41f6-9dbe-d8a1673d0b22 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1738 microversion: 2.20 time: 0.183805 Jun 15 14:47:16.870317 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 242/478] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:16 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:16.892064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-60c2c806-81e5-4e8b-92f3-d0ef4edc6260 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:16.893436 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-60c2c806-81e5-4e8b-92f3-d0ef4edc6260 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:16.901060 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-60c2c806-81e5-4e8b-92f3-d0ef4edc6260 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:16.901516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-60c2c806-81e5-4e8b-92f3-d0ef4edc6260 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:16.902286 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-60c2c806-81e5-4e8b-92f3-d0ef4edc6260 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:16.902894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-60c2c806-81e5-4e8b-92f3-d0ef4edc6260 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:17.054293 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-60c2c806-81e5-4e8b-92f3-d0ef4edc6260 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:17.063393 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-60c2c806-81e5-4e8b-92f3-d0ef4edc6260 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1713 microversion: 2.1 time: 0.176454 Jun 15 14:47:17.064257 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 237/479] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:16 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1713 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:17.876023 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:17.877396 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:17.885200 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:17.886028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:17.887012 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:17.887709 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:18.053231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:18.065255 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:18.066932 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:18.068118 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-31abaffb-09d6-4f3f-a783-94c257a593b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1738 microversion: 2.20 time: 0.197607 Jun 15 14:47:18.068847 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 243/480] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:17 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:19.091529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:19.092117 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:19.099444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:19.100056 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:19.101101 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:19.101622 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:19.242490 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:19.252410 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:19.254158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:19.255373 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2a0c9e8e-3e3e-424f-9198-8152561a1928 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1738 microversion: 2.20 time: 0.167769 Jun 15 14:47:19.256012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 238/481] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:19 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:20.286697 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:20.287739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:20.298138 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:20.298563 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:20.299381 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:20.299815 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:20.434792 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:20.447539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:20.449061 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:20.450281 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-110ed513-cb5e-4453-b10f-c26e569e8bdf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1738 microversion: 2.20 time: 0.180103 Jun 15 14:47:20.450864 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 244/482] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:20 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:21.470148 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:21.471562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:21.478804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:21.479374 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:21.480230 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:21.480745 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:21.627136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:21.636853 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:21.638578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:21.640451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1a47d0ee-e01d-4e3d-854e-b2fc462feb87 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1738 microversion: 2.20 time: 0.175603 Jun 15 14:47:21.641013 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 239/483] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:21 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:22.659595 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:22.661105 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:22.668747 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:22.669715 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:22.670825 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:22.672257 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:22.844217 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:22.851399 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:22.853284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:22.854784 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-669708b3-93d7-42c6-bf9a-f8c4ae34fea1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1738 microversion: 2.20 time: 0.200434 Jun 15 14:47:22.855491 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 245/484] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:22 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:23.875434 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:23.876451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:23.883291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:23.883975 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:23.884744 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:23.885173 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:24.017792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:24.025630 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:24.027167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:24.028336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b1344839-bace-4cda-8dda-74222906045b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1738 microversion: 2.20 time: 0.157960 Jun 15 14:47:24.028890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 240/485] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:23 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:25.048017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:25.048613 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:25.055342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:25.055776 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:25.056550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:25.056990 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:25.422808 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:25.430728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:25.432253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:25.433395 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a2bd746c-ca1b-4e36-96db-e9550996fba1 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1720 microversion: 2.20 time: 0.390018 Jun 15 14:47:25.433946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 246/486] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:25 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1720 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:26.452805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:26.453408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:26.460002 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:26.460447 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:26.461202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:26.461627 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:26.589094 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:26.597023 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:26.598562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:26.599719 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1f931c93-81b2-4387-a216-494ad230fc44 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1720 microversion: 2.20 time: 0.151508 Jun 15 14:47:26.600283 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 241/487] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:26 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:27.618195 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:27.618805 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:27.626006 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:27.626455 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:27.627260 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:27.627696 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:27.769482 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:27.777652 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:27.779259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:27.780981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-510b8726-61f5-4e97-8c80-85c1ff87c895 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1723 microversion: 2.20 time: 0.166794 Jun 15 14:47:27.781815 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 247/488] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:27 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:27.799547 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fbe96080-9e91-4c52-96e8-f5e6a995f0b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8edfeee-60e8-4be3-b404-2b43aa5ce4cc"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:27.800606 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fbe96080-9e91-4c52-96e8-f5e6a995f0b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:27.807491 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fbe96080-9e91-4c52-96e8-f5e6a995f0b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:27.807948 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fbe96080-9e91-4c52-96e8-f5e6a995f0b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:27.808734 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fbe96080-9e91-4c52-96e8-f5e6a995f0b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:27.809174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fbe96080-9e91-4c52-96e8-f5e6a995f0b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:28.124740 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fbe96080-9e91-4c52-96e8-f5e6a995f0b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324831 Jun 15 14:47:28.124740 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 242/489] 10.222.0.45 () {62 vars in 1363 bytes} [Wed Jun 15 14:47:27 2022] POST /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:47:28.247689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2916a02c-7e62-4868-8337-54c7aaa1cb54 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:28.248172 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2916a02c-7e62-4868-8337-54c7aaa1cb54 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:28.255116 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2916a02c-7e62-4868-8337-54c7aaa1cb54 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:28.255564 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2916a02c-7e62-4868-8337-54c7aaa1cb54 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:28.256322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2916a02c-7e62-4868-8337-54c7aaa1cb54 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:28.256758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2916a02c-7e62-4868-8337-54c7aaa1cb54 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:28.354658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2916a02c-7e62-4868-8337-54c7aaa1cb54 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/action" status: 202 len: 0 microversion: 2.20 time: 0.110973 Jun 15 14:47:28.355306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 248/490] 10.222.0.45 () {62 vars in 1318 bytes} [Wed Jun 15 14:47:28 2022] POST /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:47:28.364186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:28.364798 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:28.374035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:28.375030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:28.375817 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:28.376253 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:28.519572 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:28.528564 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:28.530098 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:28.531305 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3df50d4e-27bf-4633-8caf-d34962ef62ba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1749 microversion: 2.20 time: 0.171052 Jun 15 14:47:28.532121 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 243/491] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:28 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:29.255638 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-c6bc313b-d573-49a7-bc9a-c520dca05490 req-3fb140f9-e0cf-416b-b736-b0131d291e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75215a3c-bc0f-4e8b-9c52-a35946a5bfb1", "name": "network-vif-unplugged", "status": "completed", "tag": "e62eb4f5-3c82-41c8-bbba-4140a119e597"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:29.268889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c6bc313b-d573-49a7-bc9a-c520dca05490 req-3fb140f9-e0cf-416b-b736-b0131d291e3e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:29.269782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c6bc313b-d573-49a7-bc9a-c520dca05490 req-3fb140f9-e0cf-416b-b736-b0131d291e3e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:29.284539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.compute.server_external_events [req-c6bc313b-d573-49a7-bc9a-c520dca05490 req-3fb140f9-e0cf-416b-b736-b0131d291e3e service nova] Unable to find a host for instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1. Dropping event network-vif-unplugged {{(pid=124178) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 14:47:29.285581 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-c6bc313b-d573-49a7-bc9a-c520dca05490 req-3fb140f9-e0cf-416b-b736-b0131d291e3e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035590 Jun 15 14:47:29.286281 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 249/492] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 15 14:47:29.551298 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:29.551906 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:29.558393 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:29.558833 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:29.559749 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:29.560424 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:29.697867 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:29.712291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:29.713813 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:29.715029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-968a7201-b73d-4f6c-a85d-b978a0bdb5a5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1749 microversion: 2.20 time: 0.168329 Jun 15 14:47:29.715595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 244/493] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:29 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:30.734115 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:30.734721 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:30.741413 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:30.741869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:30.742631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:30.743101 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:30.894520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:30.904101 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:30.906267 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:30.907811 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-bb75fb00-0f3a-4f55-8f08-9009da5f8e40 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.178160 Jun 15 14:47:30.908393 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 250/494] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:30 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:31.927435 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:31.928040 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:31.934788 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:31.935288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:31.936064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:31.937108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:32.086337 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:32.094952 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:32.096721 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:32.097694 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cb248903-e504-420e-b5de-62a86418f6c5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.174180 Jun 15 14:47:32.098246 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 245/495] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:31 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:33.116755 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:33.117746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:33.124441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:33.124881 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:33.125644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:33.126074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:33.294871 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:33.304503 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:33.306040 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:33.307281 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-877bc385-5edb-48c1-ae31-e77f561bb246 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.194555 Jun 15 14:47:33.307858 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 251/496] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:33 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:34.327029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:34.327755 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:34.330071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=44 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:34.336148 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:34.336596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:34.337370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:34.337799 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:34.491743 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:34.501588 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:34.503102 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:34.504273 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-46a8fd64-2563-47a9-b5fa-7ce2cf49ce36 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.182493 Jun 15 14:47:34.505033 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 246/497] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:34 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:35.527317 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:35.528006 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:35.535182 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:35.535643 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:35.536478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:35.536860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:35.685530 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:35.695740 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:35.697261 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:35.698463 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2b4da614-59f0-4af7-92c8-b2a795277c3a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.175218 Jun 15 14:47:35.699247 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 252/498] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:35 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:36.721738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:36.722798 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:36.733677 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:36.734324 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:36.735410 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:36.736028 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:36.900664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:36.910735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:36.912073 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:36.913334 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b157e7c9-8a8a-42c2-9d98-de228d81ad71 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.199241 Jun 15 14:47:36.914410 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 247/499] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:36 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:37.935955 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:37.936605 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:37.939695 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=42 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:37.946185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:37.946698 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:37.947672 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:37.948310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:38.098213 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:38.106898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:38.108457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:38.109608 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7f6ec1f4-f1b3-47de-9f3a-486c7d970a9f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.179253 Jun 15 14:47:38.110161 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 253/500] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:37 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:39.129017 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:39.129616 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:39.136749 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:39.137266 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:39.138232 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:39.138668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:39.286450 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:39.295066 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:39.297230 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:39.298374 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9f6ecc44-e0ed-4c8b-8dd9-e910f42cfe65 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.173364 Jun 15 14:47:39.298925 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 248/501] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:39 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:40.317835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:40.318658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:40.327533 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:40.328001 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:40.328810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:40.329350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:40.477608 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:40.488704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:40.490254 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:40.491505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0e4c93f1-45ba-4758-b303-02a43c9dfe37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.177918 Jun 15 14:47:40.492088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 254/502] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:40 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:41.510684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:41.511287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:41.518417 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:41.518864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:41.519665 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:41.520093 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:41.658605 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:41.667252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:41.668873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:41.670025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-75018dc8-4155-4a1c-a934-2cf63e4631be tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.163341 Jun 15 14:47:41.680508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 249/503] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:41 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:42.689611 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:42.690206 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:42.697156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:42.697606 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:42.698543 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:42.698985 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:42.834331 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:42.843215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:42.844880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:42.846065 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b5ff1f4f-f2e8-4938-96a5-69d7ff3b25b7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.161165 Jun 15 14:47:42.846644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 255/504] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:42 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:43.865121 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:43.865702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:43.872275 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:43.872715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:43.873464 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:43.874008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:43.893021 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:44.010937 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:44.019438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:44.020979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:44.022252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a730dbc8-407f-4942-8caf-555062ffc319 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.161058 Jun 15 14:47:44.022809 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 250/505] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:43 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:45.041033 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:45.041648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:45.048310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:45.048756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:45.049574 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:45.050009 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:45.234036 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:45.244865 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:45.246389 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:45.247592 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c612341e-180b-440c-a0fe-ea48e7c47b3e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.210970 Jun 15 14:47:45.248162 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 256/506] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:45 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:46.266976 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:46.267644 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:46.274007 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:46.274478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:46.275253 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:46.275684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:46.459392 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:46.467669 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:46.469149 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:46.470887 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bb8a3bcb-db8c-4585-b8db-8d6716f099b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.207912 Jun 15 14:47:46.471458 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 251/507] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:46 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:47.488947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:47.489540 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:47.496148 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:47.496594 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:47.497353 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:47.497781 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:47.500355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:47.632218 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:47.640745 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:47.642242 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:47.643419 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4b60cfbe-e3ce-4fa5-9ff2-da8879256581 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.158908 Jun 15 14:47:47.644096 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 257/508] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:47 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:48.661905 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:48.662502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:48.669021 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:48.669461 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:48.670207 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:48.670636 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:48.800175 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:48.808672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:48.810181 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:48.811370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-01c498b9-297b-4c3e-a529-9d6868f2a007 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.153353 Jun 15 14:47:48.811931 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 252/509] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:48 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:48.907482 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f2f47b46-54b0-4113-8c8a-401e8a27a086 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c30ed7c-8e3b-4b1d-ae0e-a11da90e8790"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:48.908631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f2f47b46-54b0-4113-8c8a-401e8a27a086 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:48.915193 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2f47b46-54b0-4113-8c8a-401e8a27a086 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:48.915582 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2f47b46-54b0-4113-8c8a-401e8a27a086 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:48.916331 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2f47b46-54b0-4113-8c8a-401e8a27a086 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:48.916761 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2f47b46-54b0-4113-8c8a-401e8a27a086 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:49.263259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f2f47b46-54b0-4113-8c8a-401e8a27a086 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359387 Jun 15 14:47:49.264147 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 258/510] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:47:48 2022] POST /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:47:49.830613 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:49.831276 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:49.837805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:49.838252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:49.839032 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:49.839537 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:49.966722 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:49.975179 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:49.976699 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:49.977849 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-aa66fcbc-9347-455c-bc30-db92f3959b08 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.151914 Jun 15 14:47:49.978404 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 253/511] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:49 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:50.327960 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:47:50.328134 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 14:47:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:47:50.997637 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:50.998246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:51.005201 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:51.005648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:51.006400 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:51.006831 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:51.138229 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:51.146928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:51.148482 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:51.149653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e52efd8d-b06a-40ab-9865-a8f94190855d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.157063 Jun 15 14:47:51.150215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 259/512] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:50 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:52.168274 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:52.168880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:52.175503 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:52.175954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:52.176714 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:52.177147 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:52.303853 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:52.312192 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:52.314273 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:52.315472 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-516204a8-da86-4468-8223-4c54753329f3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.151167 Jun 15 14:47:52.316023 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 254/513] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:52 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:53.333878 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:53.334487 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:53.341021 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:53.341472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:53.342227 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:53.342662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:53.472081 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:53.480603 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:53.482117 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:53.483308 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-255b92b5-d06d-4a09-8e90-6c384eea5539 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.153914 Jun 15 14:47:53.483847 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 260/514] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:53 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:54.501380 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:54.502013 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:54.508532 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:54.508979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:54.509730 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:54.510252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:54.638667 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:54.646960 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:54.648484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:54.649620 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d9959c32-c7b8-4e7a-bf11-190ec4c48349 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.152143 Jun 15 14:47:54.650168 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 255/515] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:54 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:55.668723 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:55.669348 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:55.676502 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:55.677034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:55.677791 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:55.678347 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:55.827851 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:55.837062 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:55.838584 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:55.839885 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b3483edd-0d11-443c-980d-da3991cc61f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.175203 Jun 15 14:47:55.840447 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 261/516] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:55 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:56.858682 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:56.859334 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:56.865314 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:56.865792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:56.866550 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:56.866984 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:56.997611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:57.006845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:57.008451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:57.009699 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ae281ddf-97e2-4ca4-b589-f1c5da08f8e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.155021 Jun 15 14:47:57.010740 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 256/517] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:56 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:57.949518 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0f8433c1-1cc3-4cbf-afe4-67c58bb76a1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:57.950468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0f8433c1-1cc3-4cbf-afe4-67c58bb76a1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:57.957643 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f8433c1-1cc3-4cbf-afe4-67c58bb76a1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:57.958100 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f8433c1-1cc3-4cbf-afe4-67c58bb76a1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:57.958897 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f8433c1-1cc3-4cbf-afe4-67c58bb76a1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:57.959367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f8433c1-1cc3-4cbf-afe4-67c58bb76a1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:57.986687 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-0f8433c1-1cc3-4cbf-afe4-67c58bb76a1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lazy-loading 'flavor' on Instance uuid e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:47:58.027816 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:58.028577 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:58.036622 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:58.037173 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:58.038040 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:58.038528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:58.145384 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0f8433c1-1cc3-4cbf-afe4-67c58bb76a1a tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/action" status: 200 len: 32 microversion: 2.1 time: 0.199728 Jun 15 14:47:58.146324 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 262/518] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:47:57 2022] POST /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:47:58.156184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a360bc3e-8b9f-4af5-b1e8-33bc9452bf1d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:58.157041 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a360bc3e-8b9f-4af5-b1e8-33bc9452bf1d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:58.164065 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a360bc3e-8b9f-4af5-b1e8-33bc9452bf1d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:58.164660 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a360bc3e-8b9f-4af5-b1e8-33bc9452bf1d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:58.165459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a360bc3e-8b9f-4af5-b1e8-33bc9452bf1d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:58.165896 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a360bc3e-8b9f-4af5-b1e8-33bc9452bf1d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:58.186607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:58.196878 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:58.198679 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:58.199919 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0e9c471c-9132-4e68-8c32-4e0f4083ea37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.176102 Jun 15 14:47:58.200510 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 257/519] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:58 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:58.318497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a360bc3e-8b9f-4af5-b1e8-33bc9452bf1d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:58.327411 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a360bc3e-8b9f-4af5-b1e8-33bc9452bf1d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.175637 Jun 15 14:47:58.331033 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 263/520] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:58 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:58.383881 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:47:58.384292 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 14:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:47:59.330667 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:59.331329 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:59.337655 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:59.338312 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:59.340454 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:59.340454 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:59.346210 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d676caf0-b6ae-4b3b-a0b9-2e93d6fb5307 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:59.347660 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d676caf0-b6ae-4b3b-a0b9-2e93d6fb5307 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:59.359314 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d676caf0-b6ae-4b3b-a0b9-2e93d6fb5307 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:59.360225 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d676caf0-b6ae-4b3b-a0b9-2e93d6fb5307 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:59.361378 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d676caf0-b6ae-4b3b-a0b9-2e93d6fb5307 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:59.362052 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d676caf0-b6ae-4b3b-a0b9-2e93d6fb5307 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:59.554239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d676caf0-b6ae-4b3b-a0b9-2e93d6fb5307 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:59.557569 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:59.562594 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d676caf0-b6ae-4b3b-a0b9-2e93d6fb5307 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.220734 Jun 15 14:47:59.563276 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 264/521] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:59 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:59.568388 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-a264319f-0d3d-4686-bf13-81b539d26764 req-294a30cd-c4c2-4b1a-aa4e-5544bb37bc1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75215a3c-bc0f-4e8b-9c52-a35946a5bfb1", "name": "network-vif-plugged", "status": "completed", "tag": "e62eb4f5-3c82-41c8-bbba-4140a119e597"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:59.569006 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:59.570531 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:59.572802 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7a627ef2-036b-4b29-a4e6-e3cc25ede29f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.356095 Jun 15 14:47:59.573540 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 258/522] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:59 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:59.578495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-a264319f-0d3d-4686-bf13-81b539d26764 req-294a30cd-c4c2-4b1a-aa4e-5544bb37bc1e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:59.579076 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-a264319f-0d3d-4686-bf13-81b539d26764 req-294a30cd-c4c2-4b1a-aa4e-5544bb37bc1e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:59.589652 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:47:59.589880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Wed Jun 15 14:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.45) !!! Jun 15 14:47:59.592249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-a264319f-0d3d-4686-bf13-81b539d26764 req-294a30cd-c4c2-4b1a-aa4e-5544bb37bc1e service nova] Creating event network-vif-plugged:e62eb4f5-3c82-41c8-bbba-4140a119e597 for instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 on hv-cinder-80382 Jun 15 14:47:59.598287 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-a264319f-0d3d-4686-bf13-81b539d26764 req-294a30cd-c4c2-4b1a-aa4e-5544bb37bc1e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033304 Jun 15 14:47:59.599418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 265/523] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:00.580951 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b44dd62c-e210-40d7-a7c2-e4e8b60262fc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:00.581557 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b44dd62c-e210-40d7-a7c2-e4e8b60262fc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:00.588161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b44dd62c-e210-40d7-a7c2-e4e8b60262fc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:00.588613 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b44dd62c-e210-40d7-a7c2-e4e8b60262fc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:00.589383 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b44dd62c-e210-40d7-a7c2-e4e8b60262fc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:00.589827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b44dd62c-e210-40d7-a7c2-e4e8b60262fc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:00.590583 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:00.591303 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:00.597999 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:00.598459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:00.599259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:00.599694 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:00.784482 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b44dd62c-e210-40d7-a7c2-e4e8b60262fc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:00.787804 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:00.792757 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b44dd62c-e210-40d7-a7c2-e4e8b60262fc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.215726 Jun 15 14:48:00.793663 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 259/524] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:00 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:00.796254 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:00.797770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:00.799038 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2f310d26-cecb-4738-8c99-48d359660b41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.213176 Jun 15 14:48:00.799593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 266/525] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:00 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:48:01.810223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c8d73442-3f66-4c50-8190-615b8272024e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:01.811109 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c8d73442-3f66-4c50-8190-615b8272024e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:01.817623 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:01.818140 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8d73442-3f66-4c50-8190-615b8272024e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:01.818140 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8d73442-3f66-4c50-8190-615b8272024e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:01.818360 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:01.818814 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8d73442-3f66-4c50-8190-615b8272024e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:01.819272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8d73442-3f66-4c50-8190-615b8272024e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:01.824742 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:01.825195 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:01.825951 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:01.826385 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:02.011363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c8d73442-3f66-4c50-8190-615b8272024e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:02.015349 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:02.020395 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c8d73442-3f66-4c50-8190-615b8272024e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.214101 Jun 15 14:48:02.021288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 260/526] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:01 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:02.024924 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:02.026542 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:02.027826 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f84c26eb-ee2d-4777-b6d1-6702177a4039 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.214258 Jun 15 14:48:02.028454 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 267/527] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:01 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:03.037785 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-964ded5b-55a7-4b17-9cd2-3cddff545937 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:03.038397 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-964ded5b-55a7-4b17-9cd2-3cddff545937 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:03.045173 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-964ded5b-55a7-4b17-9cd2-3cddff545937 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:03.045529 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:03.045953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-964ded5b-55a7-4b17-9cd2-3cddff545937 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:03.046348 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:03.046457 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-964ded5b-55a7-4b17-9cd2-3cddff545937 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:03.046804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-964ded5b-55a7-4b17-9cd2-3cddff545937 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:03.053944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:03.054481 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:03.055332 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:03.055829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:03.244751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-964ded5b-55a7-4b17-9cd2-3cddff545937 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:03.252863 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:03.254934 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-964ded5b-55a7-4b17-9cd2-3cddff545937 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.220877 Jun 15 14:48:03.255581 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 261/528] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:03 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:03.268844 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:03.270396 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:03.271571 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5eb65d92-df29-4e54-8519-74db5efa30cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1807 microversion: 2.20 time: 0.229944 Jun 15 14:48:03.272113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 268/529] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:03 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:04.272481 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f681e6e8-dd38-4dbd-80ae-e454a7d7eda1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:04.273088 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f681e6e8-dd38-4dbd-80ae-e454a7d7eda1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:04.279711 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f681e6e8-dd38-4dbd-80ae-e454a7d7eda1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:04.280162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f681e6e8-dd38-4dbd-80ae-e454a7d7eda1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:04.280934 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f681e6e8-dd38-4dbd-80ae-e454a7d7eda1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:04.281367 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f681e6e8-dd38-4dbd-80ae-e454a7d7eda1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:04.290929 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:04.291631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:04.298662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:04.299137 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:04.299911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:04.300346 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:04.500685 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f681e6e8-dd38-4dbd-80ae-e454a7d7eda1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:04.504065 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:04.509425 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f681e6e8-dd38-4dbd-80ae-e454a7d7eda1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.240803 Jun 15 14:48:04.510011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 262/530] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:04 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:04.513333 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:04.514971 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:04.516234 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2efc0925-f40c-44d3-a678-199afc5bd480 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1794 microversion: 2.20 time: 0.229132 Jun 15 14:48:04.516921 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 269/531] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:04 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1794 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:48:05.526086 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-215fc4e5-ce69-47bc-98dd-dd9487afa642 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:05.526684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-215fc4e5-ce69-47bc-98dd-dd9487afa642 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:05.529038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=34 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:05.534805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-215fc4e5-ce69-47bc-98dd-dd9487afa642 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:05.535277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-215fc4e5-ce69-47bc-98dd-dd9487afa642 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:05.536041 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-215fc4e5-ce69-47bc-98dd-dd9487afa642 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:05.536470 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-215fc4e5-ce69-47bc-98dd-dd9487afa642 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:05.674755 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-215fc4e5-ce69-47bc-98dd-dd9487afa642 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:05.682861 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-215fc4e5-ce69-47bc-98dd-dd9487afa642 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.160987 Jun 15 14:48:05.683460 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 263/532] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:05 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:06.701063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d4b7c288-5de2-4d58-9875-010b6911397e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:06.701614 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d4b7c288-5de2-4d58-9875-010b6911397e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:06.708528 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d4b7c288-5de2-4d58-9875-010b6911397e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:06.708973 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d4b7c288-5de2-4d58-9875-010b6911397e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:06.709750 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d4b7c288-5de2-4d58-9875-010b6911397e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:06.710187 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d4b7c288-5de2-4d58-9875-010b6911397e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:06.841632 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d4b7c288-5de2-4d58-9875-010b6911397e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:06.850136 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d4b7c288-5de2-4d58-9875-010b6911397e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.153009 Jun 15 14:48:06.850700 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 270/533] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:06 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:07.867683 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e0423a9d-a29f-423b-87c3-6e6817c0486d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:07.868265 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e0423a9d-a29f-423b-87c3-6e6817c0486d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:07.875499 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0423a9d-a29f-423b-87c3-6e6817c0486d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:07.875955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0423a9d-a29f-423b-87c3-6e6817c0486d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:07.877298 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0423a9d-a29f-423b-87c3-6e6817c0486d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:07.877730 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0423a9d-a29f-423b-87c3-6e6817c0486d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:08.011296 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e0423a9d-a29f-423b-87c3-6e6817c0486d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:08.019406 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e0423a9d-a29f-423b-87c3-6e6817c0486d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.155517 Jun 15 14:48:08.019965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 264/534] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:07 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:09.037067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-774f29c6-d27c-4edc-9dd6-db1ed7756e6e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:09.037828 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-774f29c6-d27c-4edc-9dd6-db1ed7756e6e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:09.040096 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=36 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:09.045386 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-774f29c6-d27c-4edc-9dd6-db1ed7756e6e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:09.045831 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-774f29c6-d27c-4edc-9dd6-db1ed7756e6e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:09.046626 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-774f29c6-d27c-4edc-9dd6-db1ed7756e6e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:09.047080 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-774f29c6-d27c-4edc-9dd6-db1ed7756e6e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:09.049911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:09.184941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-774f29c6-d27c-4edc-9dd6-db1ed7756e6e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:09.196209 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-774f29c6-d27c-4edc-9dd6-db1ed7756e6e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.162994 Jun 15 14:48:09.196791 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 271/535] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:09 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:10.214392 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b7ecaf03-48dc-45fd-9472-4b1accb40a62 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:10.215092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b7ecaf03-48dc-45fd-9472-4b1accb40a62 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:10.222678 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b7ecaf03-48dc-45fd-9472-4b1accb40a62 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:10.223243 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b7ecaf03-48dc-45fd-9472-4b1accb40a62 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:10.224018 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b7ecaf03-48dc-45fd-9472-4b1accb40a62 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:10.224452 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b7ecaf03-48dc-45fd-9472-4b1accb40a62 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:10.364669 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b7ecaf03-48dc-45fd-9472-4b1accb40a62 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:10.372716 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b7ecaf03-48dc-45fd-9472-4b1accb40a62 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.162788 Jun 15 14:48:10.373292 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 265/536] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:10 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:11.396634 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9f087ed6-4698-4f8a-b6a2-cb529c613d6c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:11.397880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9f087ed6-4698-4f8a-b6a2-cb529c613d6c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:11.409713 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9f087ed6-4698-4f8a-b6a2-cb529c613d6c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:11.410171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9f087ed6-4698-4f8a-b6a2-cb529c613d6c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:11.410953 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9f087ed6-4698-4f8a-b6a2-cb529c613d6c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:11.411669 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9f087ed6-4698-4f8a-b6a2-cb529c613d6c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:11.547840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9f087ed6-4698-4f8a-b6a2-cb529c613d6c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:11.556459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9f087ed6-4698-4f8a-b6a2-cb529c613d6c tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.165140 Jun 15 14:48:11.557017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 272/537] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:11 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:12.573576 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ddd466e6-31c6-4a59-a293-1575801024bd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:12.574193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ddd466e6-31c6-4a59-a293-1575801024bd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:12.581775 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddd466e6-31c6-4a59-a293-1575801024bd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:12.582218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddd466e6-31c6-4a59-a293-1575801024bd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:12.583017 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddd466e6-31c6-4a59-a293-1575801024bd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:12.583454 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddd466e6-31c6-4a59-a293-1575801024bd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:12.715464 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ddd466e6-31c6-4a59-a293-1575801024bd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:12.724930 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ddd466e6-31c6-4a59-a293-1575801024bd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1737 microversion: 2.1 time: 0.155077 Jun 15 14:48:12.725854 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 266/538] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:12 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:13.742761 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b994e180-ea85-4872-b2c8-1676d2b849b8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:13.743391 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b994e180-ea85-4872-b2c8-1676d2b849b8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:13.749990 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b994e180-ea85-4872-b2c8-1676d2b849b8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:13.750435 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b994e180-ea85-4872-b2c8-1676d2b849b8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:13.751306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b994e180-ea85-4872-b2c8-1676d2b849b8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:13.751740 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b994e180-ea85-4872-b2c8-1676d2b849b8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:13.883172 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b994e180-ea85-4872-b2c8-1676d2b849b8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:13.891081 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b994e180-ea85-4872-b2c8-1676d2b849b8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1717 microversion: 2.1 time: 0.152186 Jun 15 14:48:13.892279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 273/539] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:13 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:13.946164 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:13.946749 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:13.953402 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:13.953848 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:13.955174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:13.955614 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:13.958190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=99 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:14.082045 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] HTTP exception thrown: Cannot 'detach_volume' instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 while it is in vm_state rescued Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Request method failure captured: Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments/3c30ed7c-8e3b-4b1d-ae0e-a11da90e8790 HTTP/1.1 Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_vsVqv8zUDcLKMkhdoSOpO9htG3cYnqBij9rB1tU7ynIU2RsJHWW_IP3iTlvQft_XZa9z7dM3OLaNszoULmQUE0zyL6IuFGcqtfp3avZQMZBldLZHkPHo3rjPYQhcGCfpcRu9dAVIf-d0rmTUS3-vulsb_yBx9vHIMIetjdvoFbwA Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:48:14.083701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a243ba2c3f774c10b77a052075497b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: c9a3a2e49fee4ea08ca790006d0b29e4 Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:48:14.085317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Cannot 'detach_volume' instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 while it is in vm_state rescued Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'server_id': 'e9fcc60c-8faa-4a1a-9932-9f2daeddaab1', 'id': '3c30ed7c-8e3b-4b1d-ae0e-a11da90e8790'} Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:48:14.086159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 while it is in vm_state rescued Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 while it is in vm_state rescued Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.087528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Returning 409 to user: Cannot 'detach_volume' instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 while it is in vm_state rescued {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:48:14.088505 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5b7ac503-d91b-4d8f-90fa-bad9afbd23f3 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments/3c30ed7c-8e3b-4b1d-ae0e-a11da90e8790" status: 409 len: 152 microversion: 2.1 time: 0.143366 Jun 15 14:48:14.088505 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 267/540] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 14:48:13 2022] DELETE /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments/3c30ed7c-8e3b-4b1d-ae0e-a11da90e8790 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 14:48:14.094057 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-56aa1d37-83ef-46d9-a6cc-35dea72423ec tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:14.094596 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-56aa1d37-83ef-46d9-a6cc-35dea72423ec tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:14.101358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-56aa1d37-83ef-46d9-a6cc-35dea72423ec tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.101815 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-56aa1d37-83ef-46d9-a6cc-35dea72423ec tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.102587 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-56aa1d37-83ef-46d9-a6cc-35dea72423ec tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.103132 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-56aa1d37-83ef-46d9-a6cc-35dea72423ec tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.171192 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-56aa1d37-83ef-46d9-a6cc-35dea72423ec tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "POST /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/action" status: 202 len: 0 microversion: 2.1 time: 0.080792 Jun 15 14:48:14.174928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 274/541] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:48:14 2022] POST /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:48:14.180319 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ed73c6d6-5264-45a8-b5a4-195dbd25381b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:14.181020 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ed73c6d6-5264-45a8-b5a4-195dbd25381b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:14.187909 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed73c6d6-5264-45a8-b5a4-195dbd25381b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.188394 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed73c6d6-5264-45a8-b5a4-195dbd25381b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.189690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed73c6d6-5264-45a8-b5a4-195dbd25381b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.190129 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed73c6d6-5264-45a8-b5a4-195dbd25381b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.321218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ed73c6d6-5264-45a8-b5a4-195dbd25381b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:14.329098 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ed73c6d6-5264-45a8-b5a4-195dbd25381b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1725 microversion: 2.1 time: 0.152601 Jun 15 14:48:14.330302 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 268/542] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:14 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:15.347931 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-eeff05fe-2501-472b-ae5c-22752a3bea18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:15.348629 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-eeff05fe-2501-472b-ae5c-22752a3bea18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:15.354918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eeff05fe-2501-472b-ae5c-22752a3bea18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:15.355403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eeff05fe-2501-472b-ae5c-22752a3bea18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:15.356171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eeff05fe-2501-472b-ae5c-22752a3bea18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:15.356611 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eeff05fe-2501-472b-ae5c-22752a3bea18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:15.491022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-eeff05fe-2501-472b-ae5c-22752a3bea18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:15.499131 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-eeff05fe-2501-472b-ae5c-22752a3bea18 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1725 microversion: 2.1 time: 0.156403 Jun 15 14:48:15.499703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 275/543] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:15 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:16.516215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5d035544-a4e5-4045-bb2d-745d1612f299 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:16.516866 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5d035544-a4e5-4045-bb2d-745d1612f299 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:16.523703 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d035544-a4e5-4045-bb2d-745d1612f299 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:16.524162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d035544-a4e5-4045-bb2d-745d1612f299 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:16.524975 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d035544-a4e5-4045-bb2d-745d1612f299 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:16.525417 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d035544-a4e5-4045-bb2d-745d1612f299 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:16.664218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5d035544-a4e5-4045-bb2d-745d1612f299 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:16.672154 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5d035544-a4e5-4045-bb2d-745d1612f299 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1725 microversion: 2.1 time: 0.159895 Jun 15 14:48:16.672716 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 269/544] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:16 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:48:17.690417 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4abc609b-0bc7-478b-91d8-8a180e1ea240 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:17.691045 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4abc609b-0bc7-478b-91d8-8a180e1ea240 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:17.697592 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4abc609b-0bc7-478b-91d8-8a180e1ea240 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:17.698042 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4abc609b-0bc7-478b-91d8-8a180e1ea240 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:17.698812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4abc609b-0bc7-478b-91d8-8a180e1ea240 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:17.699286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4abc609b-0bc7-478b-91d8-8a180e1ea240 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:17.830616 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4abc609b-0bc7-478b-91d8-8a180e1ea240 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:17.839074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4abc609b-0bc7-478b-91d8-8a180e1ea240 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1731 microversion: 2.1 time: 0.152987 Jun 15 14:48:17.839656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 276/545] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:17 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:17.855700 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-58fec9b0-75a9-4d82-bcf6-317145f11c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:17.856248 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-58fec9b0-75a9-4d82-bcf6-317145f11c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:17.863520 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58fec9b0-75a9-4d82-bcf6-317145f11c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:17.864008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58fec9b0-75a9-4d82-bcf6-317145f11c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:17.864818 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58fec9b0-75a9-4d82-bcf6-317145f11c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:17.865292 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58fec9b0-75a9-4d82-bcf6-317145f11c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:17.946220 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-58fec9b0-75a9-4d82-bcf6-317145f11c96 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094386 Jun 15 14:48:17.947386 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 270/546] 10.222.0.45 () {58 vars in 1274 bytes} [Wed Jun 15 14:48:17 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:18.860271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-ae1f9f05-fbf2-4790-b8ea-e9899abc667c req-8453127a-3265-42e7-b6af-ea8ece90490a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fcc60c-8faa-4a1a-9932-9f2daeddaab1", "tag": "95ee574c-18c1-4dc1-ab0f-7028091804af"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:18.869702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-ae1f9f05-fbf2-4790-b8ea-e9899abc667c req-8453127a-3265-42e7-b6af-ea8ece90490a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:18.870440 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-ae1f9f05-fbf2-4790-b8ea-e9899abc667c req-8453127a-3265-42e7-b6af-ea8ece90490a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:18.883129 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-ae1f9f05-fbf2-4790-b8ea-e9899abc667c req-8453127a-3265-42e7-b6af-ea8ece90490a service nova] Creating event network-changed:95ee574c-18c1-4dc1-ab0f-7028091804af for instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 on hv-cinder-80382 Jun 15 14:48:18.888830 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-ae1f9f05-fbf2-4790-b8ea-e9899abc667c req-8453127a-3265-42e7-b6af-ea8ece90490a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032144 Jun 15 14:48:18.889429 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 277/547] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:20.960888 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-1045f842-a091-4770-b8e8-1e90c97290e8 req-c5c18096-9582-4faf-8f16-ca80080930bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fcc60c-8faa-4a1a-9932-9f2daeddaab1", "tag": "95ee574c-18c1-4dc1-ab0f-7028091804af"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:20.969724 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-1045f842-a091-4770-b8e8-1e90c97290e8 req-c5c18096-9582-4faf-8f16-ca80080930bc service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:20.970674 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-1045f842-a091-4770-b8e8-1e90c97290e8 req-c5c18096-9582-4faf-8f16-ca80080930bc service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:20.982459 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-1045f842-a091-4770-b8e8-1e90c97290e8 req-c5c18096-9582-4faf-8f16-ca80080930bc service nova] Creating event network-changed:95ee574c-18c1-4dc1-ab0f-7028091804af for instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 on hv-cinder-80382 Jun 15 14:48:20.988336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-1045f842-a091-4770-b8e8-1e90c97290e8 req-c5c18096-9582-4faf-8f16-ca80080930bc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088327 Jun 15 14:48:20.989177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 271/548] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:24.187999 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1081f1c2-cbf5-4acc-a84a-f78bebbfd1b5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:24.187999 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1081f1c2-cbf5-4acc-a84a-f78bebbfd1b5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:24.194149 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1081f1c2-cbf5-4acc-a84a-f78bebbfd1b5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:24.194600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1081f1c2-cbf5-4acc-a84a-f78bebbfd1b5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:24.195405 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1081f1c2-cbf5-4acc-a84a-f78bebbfd1b5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:24.195852 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1081f1c2-cbf5-4acc-a84a-f78bebbfd1b5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:24.334145 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-1081f1c2-cbf5-4acc-a84a-f78bebbfd1b5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lazy-loading 'services' on Instance uuid 992c4ee6-083c-4194-adff-7bf50b93e91c {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:48:24.453330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1081f1c2-cbf5-4acc-a84a-f78bebbfd1b5 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "DELETE /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/os-volume_attachments/8cbf3e35-a5ec-4134-8116-6ccdb921a68e" status: 202 len: 0 microversion: 2.1 time: 0.376359 Jun 15 14:48:24.453930 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 278/549] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 14:48:24 2022] DELETE /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/os-volume_attachments/8cbf3e35-a5ec-4134-8116-6ccdb921a68e => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:48:25.572806 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e77031b2-fbc5-4e3f-a4e7-dc25097b2b40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:25.580723 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e77031b2-fbc5-4e3f-a4e7-dc25097b2b40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:25.581174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e77031b2-fbc5-4e3f-a4e7-dc25097b2b40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:25.645455 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e77031b2-fbc5-4e3f-a4e7-dc25097b2b40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Going to try to stop instance {{(pid=124179) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 14:48:25.689080 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e77031b2-fbc5-4e3f-a4e7-dc25097b2b40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/action" status: 202 len: 0 microversion: 2.1 time: 0.119918 Jun 15 14:48:25.689675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 272/550] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:48:25 2022] POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:48:25.698954 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b47931e8-9886-4e82-a00f-a415b8429818 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:25.699672 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b47931e8-9886-4e82-a00f-a415b8429818 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:25.708071 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b47931e8-9886-4e82-a00f-a415b8429818 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:25.708525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b47931e8-9886-4e82-a00f-a415b8429818 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:25.709527 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b47931e8-9886-4e82-a00f-a415b8429818 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:25.710014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b47931e8-9886-4e82-a00f-a415b8429818 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:25.842741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b47931e8-9886-4e82-a00f-a415b8429818 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:25.850538 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b47931e8-9886-4e82-a00f-a415b8429818 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.156266 Jun 15 14:48:25.851137 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 279/551] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:25 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:26.875322 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fa370473-626e-42d4-9c56-d4aaa17a2785 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:26.875322 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fa370473-626e-42d4-9c56-d4aaa17a2785 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:26.875996 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa370473-626e-42d4-9c56-d4aaa17a2785 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:26.875996 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa370473-626e-42d4-9c56-d4aaa17a2785 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:26.876596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa370473-626e-42d4-9c56-d4aaa17a2785 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:26.877409 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa370473-626e-42d4-9c56-d4aaa17a2785 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:27.008498 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fa370473-626e-42d4-9c56-d4aaa17a2785 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:27.016003 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fa370473-626e-42d4-9c56-d4aaa17a2785 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.151902 Jun 15 14:48:27.016573 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 273/552] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:26 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:28.034682 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a306402a-49af-472e-b68f-515106a79376 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:28.035231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a306402a-49af-472e-b68f-515106a79376 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:28.042091 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a306402a-49af-472e-b68f-515106a79376 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:28.042546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a306402a-49af-472e-b68f-515106a79376 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:28.043343 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a306402a-49af-472e-b68f-515106a79376 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:28.043783 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a306402a-49af-472e-b68f-515106a79376 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:28.175986 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a306402a-49af-472e-b68f-515106a79376 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:28.183407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a306402a-49af-472e-b68f-515106a79376 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.153382 Jun 15 14:48:28.183970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 280/553] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:28 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:29.200271 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1a8ed7e4-b93d-4c46-bb3c-190dadc9071a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:29.200912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1a8ed7e4-b93d-4c46-bb3c-190dadc9071a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:29.207587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1a8ed7e4-b93d-4c46-bb3c-190dadc9071a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:29.208044 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1a8ed7e4-b93d-4c46-bb3c-190dadc9071a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:29.208805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1a8ed7e4-b93d-4c46-bb3c-190dadc9071a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:29.209243 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1a8ed7e4-b93d-4c46-bb3c-190dadc9071a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:29.354198 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1a8ed7e4-b93d-4c46-bb3c-190dadc9071a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:29.362329 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1a8ed7e4-b93d-4c46-bb3c-190dadc9071a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.165942 Jun 15 14:48:29.362889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 274/554] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:29 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:30.379384 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a44ae4d9-f7e5-441c-b588-b0d2d3f8d23a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:30.379992 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a44ae4d9-f7e5-441c-b588-b0d2d3f8d23a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:30.386402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a44ae4d9-f7e5-441c-b588-b0d2d3f8d23a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:30.386849 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a44ae4d9-f7e5-441c-b588-b0d2d3f8d23a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:30.387643 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a44ae4d9-f7e5-441c-b588-b0d2d3f8d23a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:30.388079 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a44ae4d9-f7e5-441c-b588-b0d2d3f8d23a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:30.519141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a44ae4d9-f7e5-441c-b588-b0d2d3f8d23a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:30.526495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a44ae4d9-f7e5-441c-b588-b0d2d3f8d23a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.151072 Jun 15 14:48:30.527079 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 281/555] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:30 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:31.544165 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-def422c1-5f0f-40b0-a0cb-86b08d23351c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:31.544763 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-def422c1-5f0f-40b0-a0cb-86b08d23351c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:31.554942 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-def422c1-5f0f-40b0-a0cb-86b08d23351c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:31.555477 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-def422c1-5f0f-40b0-a0cb-86b08d23351c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:31.556251 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-def422c1-5f0f-40b0-a0cb-86b08d23351c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:31.556684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-def422c1-5f0f-40b0-a0cb-86b08d23351c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:31.688712 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-def422c1-5f0f-40b0-a0cb-86b08d23351c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:31.696246 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-def422c1-5f0f-40b0-a0cb-86b08d23351c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.155936 Jun 15 14:48:31.696808 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 275/556] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:31 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:32.713474 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9d3db142-aa51-4510-a370-4afd745ed919 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:32.714210 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9d3db142-aa51-4510-a370-4afd745ed919 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:32.720726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d3db142-aa51-4510-a370-4afd745ed919 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.721180 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d3db142-aa51-4510-a370-4afd745ed919 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.722153 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d3db142-aa51-4510-a370-4afd745ed919 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.722598 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d3db142-aa51-4510-a370-4afd745ed919 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.862898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9d3db142-aa51-4510-a370-4afd745ed919 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:32.871822 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9d3db142-aa51-4510-a370-4afd745ed919 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.162204 Jun 15 14:48:32.872394 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 282/557] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:32 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:33.889628 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-263c5b15-3e50-4cbd-9985-97202b5ebc3c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:33.890229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-263c5b15-3e50-4cbd-9985-97202b5ebc3c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:33.897391 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-263c5b15-3e50-4cbd-9985-97202b5ebc3c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:33.897839 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-263c5b15-3e50-4cbd-9985-97202b5ebc3c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:33.898601 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-263c5b15-3e50-4cbd-9985-97202b5ebc3c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:33.899064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-263c5b15-3e50-4cbd-9985-97202b5ebc3c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:34.026210 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-263c5b15-3e50-4cbd-9985-97202b5ebc3c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:34.034071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-263c5b15-3e50-4cbd-9985-97202b5ebc3c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.148348 Jun 15 14:48:34.034625 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 276/558] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:33 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:35.051685 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-18479abf-315f-483a-9fe4-10519c9b82db tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:35.052287 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-18479abf-315f-483a-9fe4-10519c9b82db tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:35.058905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18479abf-315f-483a-9fe4-10519c9b82db tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:35.059415 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18479abf-315f-483a-9fe4-10519c9b82db tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:35.060165 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18479abf-315f-483a-9fe4-10519c9b82db tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:35.060596 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18479abf-315f-483a-9fe4-10519c9b82db tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:35.187317 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-18479abf-315f-483a-9fe4-10519c9b82db tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:35.197209 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-18479abf-315f-483a-9fe4-10519c9b82db tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.149670 Jun 15 14:48:35.197783 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 283/559] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:35 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:36.217461 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1588cb7b-9c0c-4e93-86b5-487ed5b5e0b6 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:36.218090 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1588cb7b-9c0c-4e93-86b5-487ed5b5e0b6 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:36.221022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=28 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:36.226266 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1588cb7b-9c0c-4e93-86b5-487ed5b5e0b6 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:36.226708 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1588cb7b-9c0c-4e93-86b5-487ed5b5e0b6 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:36.227484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1588cb7b-9c0c-4e93-86b5-487ed5b5e0b6 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:36.227916 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1588cb7b-9c0c-4e93-86b5-487ed5b5e0b6 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:36.360038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1588cb7b-9c0c-4e93-86b5-487ed5b5e0b6 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:36.367504 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1588cb7b-9c0c-4e93-86b5-487ed5b5e0b6 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.153946 Jun 15 14:48:36.368064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 277/560] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:36 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:37.384621 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c906f3ec-53a1-4da1-8c1b-977bb83692af tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:37.385221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c906f3ec-53a1-4da1-8c1b-977bb83692af tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:37.391398 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c906f3ec-53a1-4da1-8c1b-977bb83692af tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:37.392393 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c906f3ec-53a1-4da1-8c1b-977bb83692af tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:37.393145 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c906f3ec-53a1-4da1-8c1b-977bb83692af tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:37.393580 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c906f3ec-53a1-4da1-8c1b-977bb83692af tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:37.521733 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c906f3ec-53a1-4da1-8c1b-977bb83692af tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:37.529321 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c906f3ec-53a1-4da1-8c1b-977bb83692af tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.148547 Jun 15 14:48:37.529883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 284/561] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:37 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:38.545588 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2df2a6f0-621f-4b21-a56c-f38654ee87ce tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:38.546178 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2df2a6f0-621f-4b21-a56c-f38654ee87ce tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:38.553235 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2df2a6f0-621f-4b21-a56c-f38654ee87ce tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:38.553711 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2df2a6f0-621f-4b21-a56c-f38654ee87ce tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:38.554471 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2df2a6f0-621f-4b21-a56c-f38654ee87ce tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:38.554905 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2df2a6f0-621f-4b21-a56c-f38654ee87ce tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:38.685026 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2df2a6f0-621f-4b21-a56c-f38654ee87ce tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:38.693093 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2df2a6f0-621f-4b21-a56c-f38654ee87ce tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.151401 Jun 15 14:48:38.693657 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 278/562] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:38 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:39.710554 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-33e3325e-b807-4071-8b58-a0de66e0183a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:39.711556 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-33e3325e-b807-4071-8b58-a0de66e0183a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:39.714084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=28 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:39.719629 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-33e3325e-b807-4071-8b58-a0de66e0183a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:39.720086 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-33e3325e-b807-4071-8b58-a0de66e0183a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:39.721300 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-33e3325e-b807-4071-8b58-a0de66e0183a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:39.721740 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-33e3325e-b807-4071-8b58-a0de66e0183a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:39.724636 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:39.854382 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-33e3325e-b807-4071-8b58-a0de66e0183a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:39.861856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-33e3325e-b807-4071-8b58-a0de66e0183a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.155270 Jun 15 14:48:39.862420 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 285/563] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:39 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:40.878704 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-22db4cdb-9047-40c1-a91f-faa6ded27862 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:40.879339 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-22db4cdb-9047-40c1-a91f-faa6ded27862 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:40.885779 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22db4cdb-9047-40c1-a91f-faa6ded27862 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:40.886226 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22db4cdb-9047-40c1-a91f-faa6ded27862 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:40.886984 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22db4cdb-9047-40c1-a91f-faa6ded27862 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:40.887444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22db4cdb-9047-40c1-a91f-faa6ded27862 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:41.017850 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-22db4cdb-9047-40c1-a91f-faa6ded27862 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:41.025269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-22db4cdb-9047-40c1-a91f-faa6ded27862 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1677 microversion: 2.1 time: 0.150464 Jun 15 14:48:41.025839 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 279/564] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:40 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:42.043354 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-56e5870e-03e6-4b55-bc23-f2d8a4ce4af9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:42.043877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-56e5870e-03e6-4b55-bc23-f2d8a4ce4af9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:42.051054 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-56e5870e-03e6-4b55-bc23-f2d8a4ce4af9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:42.051507 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-56e5870e-03e6-4b55-bc23-f2d8a4ce4af9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:42.052263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-56e5870e-03e6-4b55-bc23-f2d8a4ce4af9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:42.052698 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-56e5870e-03e6-4b55-bc23-f2d8a4ce4af9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:42.177955 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-56e5870e-03e6-4b55-bc23-f2d8a4ce4af9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:42.185413 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-56e5870e-03e6-4b55-bc23-f2d8a4ce4af9 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1654 microversion: 2.1 time: 0.146077 Jun 15 14:48:42.185966 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 286/565] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:42 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:42.201356 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-99e9737c-d248-414c-b0b4-26242f5724ad tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:42.208174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99e9737c-d248-414c-b0b4-26242f5724ad tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:42.208625 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99e9737c-d248-414c-b0b4-26242f5724ad tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:42.230604 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-99e9737c-d248-414c-b0b4-26242f5724ad tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Going to try to start instance {{(pid=124179) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 14:48:42.274656 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-99e9737c-d248-414c-b0b4-26242f5724ad tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/action" status: 202 len: 0 microversion: 2.1 time: 0.076930 Jun 15 14:48:42.275289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 280/566] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:48:42 2022] POST /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:48:42.284425 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f5e60717-fb9c-4e4f-9b34-7d019a601758 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:42.285117 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f5e60717-fb9c-4e4f-9b34-7d019a601758 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:42.291253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5e60717-fb9c-4e4f-9b34-7d019a601758 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:42.291713 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5e60717-fb9c-4e4f-9b34-7d019a601758 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:42.292532 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5e60717-fb9c-4e4f-9b34-7d019a601758 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:42.292911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5e60717-fb9c-4e4f-9b34-7d019a601758 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:42.428696 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f5e60717-fb9c-4e4f-9b34-7d019a601758 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:42.436409 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f5e60717-fb9c-4e4f-9b34-7d019a601758 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1663 microversion: 2.1 time: 0.156700 Jun 15 14:48:42.437005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 287/567] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:42 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:43.454308 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-72cfa3b8-ced5-4fbc-86db-f7bbd92cff38 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:43.455099 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-72cfa3b8-ced5-4fbc-86db-f7bbd92cff38 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:43.461217 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72cfa3b8-ced5-4fbc-86db-f7bbd92cff38 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:43.461663 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72cfa3b8-ced5-4fbc-86db-f7bbd92cff38 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:43.462503 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72cfa3b8-ced5-4fbc-86db-f7bbd92cff38 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:43.462935 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72cfa3b8-ced5-4fbc-86db-f7bbd92cff38 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:43.601885 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-72cfa3b8-ced5-4fbc-86db-f7bbd92cff38 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:43.609352 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-72cfa3b8-ced5-4fbc-86db-f7bbd92cff38 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1663 microversion: 2.1 time: 0.159695 Jun 15 14:48:43.609914 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 281/568] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:43 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:44.627785 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-591b4d0e-0f35-4d87-9ef6-149d71e70400 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:44.628393 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-591b4d0e-0f35-4d87-9ef6-149d71e70400 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:44.634912 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-591b4d0e-0f35-4d87-9ef6-149d71e70400 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:44.635394 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-591b4d0e-0f35-4d87-9ef6-149d71e70400 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:44.636167 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-591b4d0e-0f35-4d87-9ef6-149d71e70400 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:44.636607 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-591b4d0e-0f35-4d87-9ef6-149d71e70400 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:44.766606 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-591b4d0e-0f35-4d87-9ef6-149d71e70400 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:44.774162 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-591b4d0e-0f35-4d87-9ef6-149d71e70400 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1667 microversion: 2.1 time: 0.150877 Jun 15 14:48:44.774758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 288/569] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:44 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:11.540827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c8c20aa7-2f13-4092-a114-65f0c64b6bd6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:11.541392 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c8c20aa7-2f13-4092-a114-65f0c64b6bd6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:11.543544 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=9 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:11.544198 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:11.550620 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8c20aa7-2f13-4092-a114-65f0c64b6bd6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.551095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8c20aa7-2f13-4092-a114-65f0c64b6bd6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.551860 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8c20aa7-2f13-4092-a114-65f0c64b6bd6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.552331 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8c20aa7-2f13-4092-a114-65f0c64b6bd6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.581954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c8c20aa7-2f13-4092-a114-65f0c64b6bd6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments/d8edfeee-60e8-4be3-b404-2b43aa5ce4cc" status: 200 len: 194 microversion: 2.20 time: 0.045235 Jun 15 14:49:11.582560 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 282/570] 10.222.0.45 () {60 vars in 1453 bytes} [Wed Jun 15 14:49:11 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments/d8edfeee-60e8-4be3-b404-2b43aa5ce4cc => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:49:11.643585 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1d79fd29-5e96-4b01-9f10-19da9123f561 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:11.644082 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1d79fd29-5e96-4b01-9f10-19da9123f561 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:11.646078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=7 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:11.646858 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=23 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:11.652975 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1d79fd29-5e96-4b01-9f10-19da9123f561 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.653419 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1d79fd29-5e96-4b01-9f10-19da9123f561 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.654171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1d79fd29-5e96-4b01-9f10-19da9123f561 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.654602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1d79fd29-5e96-4b01-9f10-19da9123f561 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.736338 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-1d79fd29-5e96-4b01-9f10-19da9123f561 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lazy-loading 'services' on Instance uuid 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:11.806935 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1d79fd29-5e96-4b01-9f10-19da9123f561 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments/d8edfeee-60e8-4be3-b404-2b43aa5ce4cc" status: 202 len: 0 microversion: 2.20 time: 0.167178 Jun 15 14:49:11.807556 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 289/571] 10.222.0.45 () {60 vars in 1456 bytes} [Wed Jun 15 14:49:11 2022] DELETE /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments/d8edfeee-60e8-4be3-b404-2b43aa5ce4cc => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:49:11.821007 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-40d9c1c2-7e3a-411d-8543-d3c2cef9e1fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:11.822137 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-40d9c1c2-7e3a-411d-8543-d3c2cef9e1fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:11.828745 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40d9c1c2-7e3a-411d-8543-d3c2cef9e1fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.829322 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40d9c1c2-7e3a-411d-8543-d3c2cef9e1fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.830265 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40d9c1c2-7e3a-411d-8543-d3c2cef9e1fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.830708 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40d9c1c2-7e3a-411d-8543-d3c2cef9e1fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.861288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-40d9c1c2-7e3a-411d-8543-d3c2cef9e1fb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049102 Jun 15 14:49:11.861851 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 283/572] 10.222.0.45 () {60 vars in 1342 bytes} [Wed Jun 15 14:49:11 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:49:12.874113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-74e5481f-eb3c-4b51-8dcd-a5808faecc02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:12.875210 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-74e5481f-eb3c-4b51-8dcd-a5808faecc02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:12.883127 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-74e5481f-eb3c-4b51-8dcd-a5808faecc02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:12.883590 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-74e5481f-eb3c-4b51-8dcd-a5808faecc02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:12.884332 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-74e5481f-eb3c-4b51-8dcd-a5808faecc02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:12.884759 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-74e5481f-eb3c-4b51-8dcd-a5808faecc02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:12.916690 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-74e5481f-eb3c-4b51-8dcd-a5808faecc02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047123 Jun 15 14:49:12.917445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 290/573] 10.222.0.45 () {60 vars in 1342 bytes} [Wed Jun 15 14:49:12 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:49:13.929042 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-efc5f3c1-14bb-42f2-b8eb-83fe8698ebba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:13.929945 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-efc5f3c1-14bb-42f2-b8eb-83fe8698ebba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:13.936552 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efc5f3c1-14bb-42f2-b8eb-83fe8698ebba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:13.936998 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efc5f3c1-14bb-42f2-b8eb-83fe8698ebba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:13.937746 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efc5f3c1-14bb-42f2-b8eb-83fe8698ebba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:13.938172 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efc5f3c1-14bb-42f2-b8eb-83fe8698ebba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:13.974345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-efc5f3c1-14bb-42f2-b8eb-83fe8698ebba tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049207 Jun 15 14:49:13.974903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 284/574] 10.222.0.45 () {60 vars in 1342 bytes} [Wed Jun 15 14:49:13 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:14.032779 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f2a3a079-fb36-453a-8301-aa85e883a3a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:14.033274 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f2a3a079-fb36-453a-8301-aa85e883a3a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:14.039928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2a3a079-fb36-453a-8301-aa85e883a3a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:14.040380 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2a3a079-fb36-453a-8301-aa85e883a3a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:14.041137 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2a3a079-fb36-453a-8301-aa85e883a3a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:14.041574 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2a3a079-fb36-453a-8301-aa85e883a3a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:14.067320 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f2a3a079-fb36-453a-8301-aa85e883a3a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:49:14.140006 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f2a3a079-fb36-453a-8301-aa85e883a3a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 204 len: 0 microversion: 2.20 time: 0.110676 Jun 15 14:49:14.140838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 291/575] 10.222.0.45 () {60 vars in 1279 bytes} [Wed Jun 15 14:49:14 2022] DELETE /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 14:49:14.149166 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:14.149765 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:14.155762 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:14.156208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:14.156970 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:14.157402 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:14.292528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:14.301333 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:14.302859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:14.304057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ff5447f5-fb34-4ffd-9c0c-7d74e0e7c78e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.158804 Jun 15 14:49:14.304621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 285/576] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:14 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:15.322906 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:15.323641 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:15.330051 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:15.330500 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:15.331285 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:15.331718 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:15.458969 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:15.466934 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:15.468484 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:15.469632 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-10df3292-8f56-4ecd-9039-bb098eea83bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.151018 Jun 15 14:49:15.470196 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 292/577] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:15 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:16.489098 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:16.489703 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:16.496231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:16.496610 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:16.497367 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:16.497798 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:16.628474 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:16.636572 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:16.638078 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:16.639250 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9ad0e65b-a4f9-4ea2-a135-551a7a389120 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.154080 Jun 15 14:49:16.639810 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 286/578] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:16 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:17.404337 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-80b47672-f52b-4015-a513-2d92dac0505b req-1bc310bf-ce54-41bc-9a6c-4c698e3a398e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75215a3c-bc0f-4e8b-9c52-a35946a5bfb1", "name": "network-vif-deleted", "tag": "e62eb4f5-3c82-41c8-bbba-4140a119e597"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:17.414360 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-80b47672-f52b-4015-a513-2d92dac0505b req-1bc310bf-ce54-41bc-9a6c-4c698e3a398e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:17.415030 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-80b47672-f52b-4015-a513-2d92dac0505b req-1bc310bf-ce54-41bc-9a6c-4c698e3a398e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:17.428454 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-80b47672-f52b-4015-a513-2d92dac0505b req-1bc310bf-ce54-41bc-9a6c-4c698e3a398e service nova] Creating event network-vif-deleted:e62eb4f5-3c82-41c8-bbba-4140a119e597 for instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 on hv-cinder-80382 Jun 15 14:49:17.434258 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-80b47672-f52b-4015-a513-2d92dac0505b req-1bc310bf-ce54-41bc-9a6c-4c698e3a398e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114616 Jun 15 14:49:17.434859 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 293/579] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:17.657808 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:17.658891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:17.666352 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:17.666753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:17.667553 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:17.667990 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:17.700382 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:17.700831 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:17.701290 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lazy-loading 'fault' on Instance uuid 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:17.993422 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:18.015974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:18.018235 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:18.019467 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cca48763-77b1-4876-9761-15c39b014858 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 200 len: 1370 microversion: 2.20 time: 0.366242 Jun 15 14:49:18.021307 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 287/580] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:17 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 1370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:18.518710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0e611bbc-30ab-4030-80f6-d662cf5ac131 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:18.519370 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0e611bbc-30ab-4030-80f6-d662cf5ac131 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:18.526457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e611bbc-30ab-4030-80f6-d662cf5ac131 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:18.526921 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e611bbc-30ab-4030-80f6-d662cf5ac131 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:18.527737 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e611bbc-30ab-4030-80f6-d662cf5ac131 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:18.528181 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e611bbc-30ab-4030-80f6-d662cf5ac131 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:18.553442 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-0e611bbc-30ab-4030-80f6-d662cf5ac131 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lazy-loading 'flavor' on Instance uuid c32b0d85-8788-4ac8-9e61-faee2f6abee5 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:18.624833 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0e611bbc-30ab-4030-80f6-d662cf5ac131 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "POST /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5/action" status: 202 len: 0 microversion: 2.1 time: 0.110270 Jun 15 14:49:18.625759 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 294/581] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:49:18 2022] POST /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:49:18.634404 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f62f10c1-1e8b-4c26-a257-7b77c2de8707 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:18.635046 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f62f10c1-1e8b-4c26-a257-7b77c2de8707 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:18.641721 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f62f10c1-1e8b-4c26-a257-7b77c2de8707 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:18.642322 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f62f10c1-1e8b-4c26-a257-7b77c2de8707 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:18.643540 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f62f10c1-1e8b-4c26-a257-7b77c2de8707 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:18.644041 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f62f10c1-1e8b-4c26-a257-7b77c2de8707 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:18.790106 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f62f10c1-1e8b-4c26-a257-7b77c2de8707 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:18.798786 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f62f10c1-1e8b-4c26-a257-7b77c2de8707 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.167615 Jun 15 14:49:18.799482 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 288/582] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:18 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:19.039200 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:19.039811 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:19.046253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:19.046709 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:19.047506 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:19.048681 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:19.064273 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] HTTP exception thrown: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Request method failure captured: Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 HTTP/1.1 Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_zZixbaRFUMdtfNlKZN_4qoJiGm4dkZ9oau08zguSrgmDsRFiXZTcbu2F5rf_s1w447PoJDiX4fszRLyiqv1PJkTC4by-pl-XkJSzRuUo9L4-t3jCq1aFOb0GckSxDj5Z6pLmxjY8X61MfcvcQB31lqoO_OojxKrQ--Ra2K8KllAs Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:49:19.066067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 25ba370b8daf49e48514cd49c2851215 Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:49:19.068762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '75215a3c-bc0f-4e8b-9c52-a35946a5bfb1'} Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:19.070186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:49:19.072539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:19.074928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Returning 404 to user: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:19.074928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cd9cfadf-e674-4aae-843e-9c13322b7500 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 404 len: 111 microversion: 2.20 time: 0.032927 Jun 15 14:49:19.074928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 295/583] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:19 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:49:19.081219 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-08f16d8a-b0e1-40ef-b305-de50e026a550 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '.version_select at 0x7f05bc058040>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:19.104930 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-08f16d8a-b0e1-40ef-b305-de50e026a550 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655202180" status: 204 len: 0 microversion: 2.20 time: 0.028256 Jun 15 14:49:19.105621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 289/584] 10.222.0.45 () {60 vars in 1258 bytes} [Wed Jun 15 14:49:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655202180 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 14:49:19.765353 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f4e9254a-df0d-4e81-b78d-340c09ba8b18 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'create', calling method: .version_select at 0x7f05b77c7790>, body: {"keypair": {"name": "tempest-keypair-92655115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf/AmIcQMs06+xz//Yw/8CZZeRm1tBGhKQGXWaku4pSTCDxTyELy8/5LQjEHggME4kZueReV/TUFFnquD6a6xOmD4pl1nTvaF1Ob+cfklUejbDYLVRm1C0kjSmHPl+M2w=="}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:19.780119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-f4e9254a-df0d-4e81-b78d-340c09ba8b18 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Getting quotas for project 54d57ba7dd0d441b9748fc600bc34972. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:49:19.783920 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-f4e9254a-df0d-4e81-b78d-340c09ba8b18 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Getting quotas for user 25ba370b8daf49e48514cd49c2851215 and project 54d57ba7dd0d441b9748fc600bc34972. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:49:19.809997 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f4e9254a-df0d-4e81-b78d-340c09ba8b18 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.048488 Jun 15 14:49:19.810764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 296/585] 10.222.0.45 () {62 vars in 1199 bytes} [Wed Jun 15 14:49:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 14:49:19.817426 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4a348bb3-9c41-4c36-bd75-dd6144ae3d19 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:19.818175 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4a348bb3-9c41-4c36-bd75-dd6144ae3d19 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:19.825095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a348bb3-9c41-4c36-bd75-dd6144ae3d19 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:19.825543 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a348bb3-9c41-4c36-bd75-dd6144ae3d19 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:19.826522 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a348bb3-9c41-4c36-bd75-dd6144ae3d19 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:19.827414 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a348bb3-9c41-4c36-bd75-dd6144ae3d19 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:20.045993 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4a348bb3-9c41-4c36-bd75-dd6144ae3d19 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:20.054494 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4a348bb3-9c41-4c36-bd75-dd6144ae3d19 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.242076 Jun 15 14:49:20.055099 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 290/586] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:19 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:21.073306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-43d94232-a6da-4e11-a815-f537ea9a8170 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:21.073920 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-43d94232-a6da-4e11-a815-f537ea9a8170 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:21.081865 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-43d94232-a6da-4e11-a815-f537ea9a8170 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:21.082326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-43d94232-a6da-4e11-a815-f537ea9a8170 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:21.083164 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-43d94232-a6da-4e11-a815-f537ea9a8170 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:21.083592 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-43d94232-a6da-4e11-a815-f537ea9a8170 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:21.139615 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1762827818", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd9528e4-f2a6-40a3-805a-4917720b5f35"}], "security_groups": [{"name": "tempest-securitygroup--745067861"}], "key_name": "tempest-keypair-92655115", "user_data": "}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:21.238301 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-43d94232-a6da-4e11-a815-f537ea9a8170 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:21.246049 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-43d94232-a6da-4e11-a815-f537ea9a8170 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.176987 Jun 15 14:49:21.246550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 297/587] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:21 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:21.270132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] validate_networks() for [('cd9528e4-f2a6-40a3-805a-4917720b5f35', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:49:21.679276 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:49:21.679705 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:49:21.680185 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:49:21.680595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:49:21.681007 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:49:21.690573 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:21.691048 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:21.691856 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:21.692295 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:21.710837 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Getting quotas for project 54d57ba7dd0d441b9748fc600bc34972. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:49:21.715533 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Getting quotas for user 25ba370b8daf49e48514cd49c2851215 and project 54d57ba7dd0d441b9748fc600bc34972. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:49:21.727238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:49:21.729520 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:49:21.776316 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b85d8f6f-55a6-4856-b6f3-9156440d165d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.641084 Jun 15 14:49:21.776959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 291/588] 10.222.0.45 () {62 vars in 1187 bytes} [Wed Jun 15 14:49:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 15 14:49:21.787561 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8c76850c-5e86-4af8-bc74-9f641a8276fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:21.788169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8c76850c-5e86-4af8-bc74-9f641a8276fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:21.844215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8c76850c-5e86-4af8-bc74-9f641a8276fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:21.853239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8c76850c-5e86-4af8-bc74-9f641a8276fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:21.854748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8c76850c-5e86-4af8-bc74-9f641a8276fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:21.855891 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8c76850c-5e86-4af8-bc74-9f641a8276fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1280 microversion: 2.20 time: 0.072413 Jun 15 14:49:21.856457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 298/589] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:21 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:22.264901 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a78cbec-32ac-43a9-ae28-69544c1d62d2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:22.265728 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0a78cbec-32ac-43a9-ae28-69544c1d62d2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:22.273596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a78cbec-32ac-43a9-ae28-69544c1d62d2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:22.274050 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a78cbec-32ac-43a9-ae28-69544c1d62d2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:22.274822 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a78cbec-32ac-43a9-ae28-69544c1d62d2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:22.275284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a78cbec-32ac-43a9-ae28-69544c1d62d2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:22.414082 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0a78cbec-32ac-43a9-ae28-69544c1d62d2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:22.421660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0a78cbec-32ac-43a9-ae28-69544c1d62d2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.161432 Jun 15 14:49:22.422221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 292/590] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:22 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:22.873802 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:22.874487 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:22.882292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:22.882837 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:22.883822 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:22.884517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:22.951267 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:22.960997 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:22.962672 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:22.964074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-10c14793-150f-404b-b75b-f82a7e6714bb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1340 microversion: 2.20 time: 0.094202 Jun 15 14:49:22.965253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 299/591] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:22 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1340 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:23.438622 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b842a2fb-f45b-44ca-be0a-d24ead8143f8 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:23.439280 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b842a2fb-f45b-44ca-be0a-d24ead8143f8 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:23.445842 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b842a2fb-f45b-44ca-be0a-d24ead8143f8 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:23.446282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b842a2fb-f45b-44ca-be0a-d24ead8143f8 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:23.447069 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b842a2fb-f45b-44ca-be0a-d24ead8143f8 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:23.447500 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b842a2fb-f45b-44ca-be0a-d24ead8143f8 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:23.584586 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b842a2fb-f45b-44ca-be0a-d24ead8143f8 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:23.592264 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b842a2fb-f45b-44ca-be0a-d24ead8143f8 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.157631 Jun 15 14:49:23.592834 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 293/592] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:23 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:23.983311 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:23.984539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:23.991496 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:23.992299 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:23.993261 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:23.993883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:24.148254 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:24.156825 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:24.158278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:24.159646 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b7533cc9-e95f-43fc-b351-21c0923575cf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.180003 Jun 15 14:49:24.160372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 300/593] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:23 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:24.489783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-bbfeec43-b5c7-4d09-9de5-359fb17a9640 req-04240c9b-939f-440e-9281-87b38183a6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00a072c-e13e-4b90-b5f4-7341aea301b7", "tag": "5b328c6b-5677-47c6-b09a-974f22b96d56"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:24.499225 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-bbfeec43-b5c7-4d09-9de5-359fb17a9640 req-04240c9b-939f-440e-9281-87b38183a6a2 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:24.499754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-bbfeec43-b5c7-4d09-9de5-359fb17a9640 req-04240c9b-939f-440e-9281-87b38183a6a2 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:24.513504 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-bbfeec43-b5c7-4d09-9de5-359fb17a9640 req-04240c9b-939f-440e-9281-87b38183a6a2 service nova] Creating event network-changed:5b328c6b-5677-47c6-b09a-974f22b96d56 for instance c00a072c-e13e-4b90-b5f4-7341aea301b7 on hv-cinder-80382 Jun 15 14:49:24.518715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-bbfeec43-b5c7-4d09-9de5-359fb17a9640 req-04240c9b-939f-440e-9281-87b38183a6a2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033171 Jun 15 14:49:24.519986 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 294/594] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:24.609790 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-13e83f48-c66d-4a10-9f60-d0e0d7d3a748 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:24.611804 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-13e83f48-c66d-4a10-9f60-d0e0d7d3a748 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:24.618382 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-13e83f48-c66d-4a10-9f60-d0e0d7d3a748 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:24.618962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-13e83f48-c66d-4a10-9f60-d0e0d7d3a748 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:24.619968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-13e83f48-c66d-4a10-9f60-d0e0d7d3a748 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:24.620410 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-13e83f48-c66d-4a10-9f60-d0e0d7d3a748 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:24.761103 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-13e83f48-c66d-4a10-9f60-d0e0d7d3a748 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:24.768816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-13e83f48-c66d-4a10-9f60-d0e0d7d3a748 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.162941 Jun 15 14:49:24.769390 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 301/595] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:24 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:24.865174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6118a14f-2fc1-41e9-8c0f-26a43695d137 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:24.866130 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6118a14f-2fc1-41e9-8c0f-26a43695d137 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:24.872971 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6118a14f-2fc1-41e9-8c0f-26a43695d137 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:24.873420 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6118a14f-2fc1-41e9-8c0f-26a43695d137 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:24.874197 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6118a14f-2fc1-41e9-8c0f-26a43695d137 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:24.874643 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6118a14f-2fc1-41e9-8c0f-26a43695d137 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:24.959465 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-6118a14f-2fc1-41e9-8c0f-26a43695d137 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lazy-loading 'services' on Instance uuid e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:25.081600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6118a14f-2fc1-41e9-8c0f-26a43695d137 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments/3c30ed7c-8e3b-4b1d-ae0e-a11da90e8790" status: 202 len: 0 microversion: 2.1 time: 0.221239 Jun 15 14:49:25.082226 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 295/596] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 14:49:24 2022] DELETE /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments/3c30ed7c-8e3b-4b1d-ae0e-a11da90e8790 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:49:25.090776 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-843f93b6-6817-485e-8707-9afe3b335630 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:25.091796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-843f93b6-6817-485e-8707-9afe3b335630 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:25.099025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-843f93b6-6817-485e-8707-9afe3b335630 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:25.099481 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-843f93b6-6817-485e-8707-9afe3b335630 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:25.100479 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-843f93b6-6817-485e-8707-9afe3b335630 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:25.100913 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-843f93b6-6817-485e-8707-9afe3b335630 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:25.130874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-843f93b6-6817-485e-8707-9afe3b335630 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Jun 15 14:49:25.131391 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 302/597] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:25 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:25.178260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:25.178947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:25.185308 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:25.185754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:25.186512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:25.186948 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:25.317852 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:25.325795 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:25.327327 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:25.328408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3cd9eab8-d9f3-46eb-b571-8fc970ec3fe6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.154497 Jun 15 14:49:25.329493 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 296/598] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:25 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:25.785637 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fe70a807-8300-4804-92c0-b66ad51cddef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:25.786238 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fe70a807-8300-4804-92c0-b66ad51cddef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:25.792484 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fe70a807-8300-4804-92c0-b66ad51cddef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:25.792932 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fe70a807-8300-4804-92c0-b66ad51cddef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:25.793691 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fe70a807-8300-4804-92c0-b66ad51cddef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:25.794121 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fe70a807-8300-4804-92c0-b66ad51cddef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:25.922445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fe70a807-8300-4804-92c0-b66ad51cddef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:25.930817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fe70a807-8300-4804-92c0-b66ad51cddef tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.149387 Jun 15 14:49:25.931416 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 303/599] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:25 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:26.143023 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c2eb9726-71db-44be-9165-993f43337985 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:26.144053 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c2eb9726-71db-44be-9165-993f43337985 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:26.150515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2eb9726-71db-44be-9165-993f43337985 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:26.150969 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2eb9726-71db-44be-9165-993f43337985 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:26.151765 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2eb9726-71db-44be-9165-993f43337985 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:26.152208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2eb9726-71db-44be-9165-993f43337985 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:26.182300 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c2eb9726-71db-44be-9165-993f43337985 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043207 Jun 15 14:49:26.182869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 297/600] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:26 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:26.347183 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:26.347788 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:26.354246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:26.354790 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:26.355667 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:26.356097 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:26.374292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:26.487290 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:26.495301 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:26.496823 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:26.497917 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-98c5bbf3-1eed-47dc-89a1-30bff186ef85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.155197 Jun 15 14:49:26.498475 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 304/601] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:26 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:26.948196 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f6ccb9ab-8393-4ce7-9e27-74dc0f36f1b0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:26.948803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f6ccb9ab-8393-4ce7-9e27-74dc0f36f1b0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:26.955941 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f6ccb9ab-8393-4ce7-9e27-74dc0f36f1b0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:26.956393 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f6ccb9ab-8393-4ce7-9e27-74dc0f36f1b0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:26.957167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f6ccb9ab-8393-4ce7-9e27-74dc0f36f1b0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:26.957603 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f6ccb9ab-8393-4ce7-9e27-74dc0f36f1b0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:27.089293 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f6ccb9ab-8393-4ce7-9e27-74dc0f36f1b0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:27.096763 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f6ccb9ab-8393-4ce7-9e27-74dc0f36f1b0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.152458 Jun 15 14:49:27.097324 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 298/602] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:26 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:27.194569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2c828c3b-3af0-409f-a69a-e0ee938f5bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:27.195528 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2c828c3b-3af0-409f-a69a-e0ee938f5bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:27.201616 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2c828c3b-3af0-409f-a69a-e0ee938f5bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:27.202074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2c828c3b-3af0-409f-a69a-e0ee938f5bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:27.202837 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2c828c3b-3af0-409f-a69a-e0ee938f5bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:27.203307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2c828c3b-3af0-409f-a69a-e0ee938f5bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:27.233621 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2c828c3b-3af0-409f-a69a-e0ee938f5bc0 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043019 Jun 15 14:49:27.234173 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 305/603] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:27 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:27.515994 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:27.516731 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:27.523013 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:27.523478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:27.524234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:27.524663 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:27.667030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:27.670521 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:27.677123 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:27.678630 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:27.679745 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0d18d442-0be7-44c8-9530-ac0b579736a3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.167974 Jun 15 14:49:27.680301 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 299/604] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:27 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:28.113550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f9bc7cbb-d1b1-499f-bf7e-704fd4108ca9 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:28.114143 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f9bc7cbb-d1b1-499f-bf7e-704fd4108ca9 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:28.120622 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f9bc7cbb-d1b1-499f-bf7e-704fd4108ca9 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:28.121073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f9bc7cbb-d1b1-499f-bf7e-704fd4108ca9 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:28.121829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f9bc7cbb-d1b1-499f-bf7e-704fd4108ca9 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:28.122264 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f9bc7cbb-d1b1-499f-bf7e-704fd4108ca9 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:28.246447 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-659094b7-268c-41ef-923f-35e975058edb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:28.247454 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-659094b7-268c-41ef-923f-35e975058edb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:28.254481 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-659094b7-268c-41ef-923f-35e975058edb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:28.254932 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-659094b7-268c-41ef-923f-35e975058edb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:28.255743 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-659094b7-268c-41ef-923f-35e975058edb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:28.256165 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-659094b7-268c-41ef-923f-35e975058edb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:28.269529 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f9bc7cbb-d1b1-499f-bf7e-704fd4108ca9 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:28.282873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f9bc7cbb-d1b1-499f-bf7e-704fd4108ca9 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.172672 Jun 15 14:49:28.283712 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 306/605] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:28 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:28.297578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-659094b7-268c-41ef-923f-35e975058edb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054953 Jun 15 14:49:28.298317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 300/606] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:28 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:49:28.697732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:28.698330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:28.704954 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:28.705398 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:28.706149 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:28.706575 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:28.834227 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:28.842257 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:28.843822 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:28.844921 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b89c8e75-c6b1-4124-828d-979a2a48ed5a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.151154 Jun 15 14:49:28.845484 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 307/607] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:28 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:29.302200 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2de8234d-5bef-4b09-ba07-ffd3d19b9dce tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:29.302918 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2de8234d-5bef-4b09-ba07-ffd3d19b9dce tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:29.309097 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f55724b6-ee76-433f-85cb-c44bbd3d867b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:29.309670 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2de8234d-5bef-4b09-ba07-ffd3d19b9dce tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.310136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2de8234d-5bef-4b09-ba07-ffd3d19b9dce tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:29.310295 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f55724b6-ee76-433f-85cb-c44bbd3d867b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:29.311263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2de8234d-5bef-4b09-ba07-ffd3d19b9dce tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.311735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2de8234d-5bef-4b09-ba07-ffd3d19b9dce tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:29.317453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f55724b6-ee76-433f-85cb-c44bbd3d867b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.317453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f55724b6-ee76-433f-85cb-c44bbd3d867b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:29.318507 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f55724b6-ee76-433f-85cb-c44bbd3d867b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.318626 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f55724b6-ee76-433f-85cb-c44bbd3d867b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:29.352437 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f55724b6-ee76-433f-85cb-c44bbd3d867b tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047138 Jun 15 14:49:29.353016 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 308/608] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:29 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 14:49:29.428679 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-982d5fa2-a4bb-4cca-9b5b-047eb461eaf2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:29.429180 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-982d5fa2-a4bb-4cca-9b5b-047eb461eaf2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:29.436201 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-982d5fa2-a4bb-4cca-9b5b-047eb461eaf2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.436685 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-982d5fa2-a4bb-4cca-9b5b-047eb461eaf2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:29.437465 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-982d5fa2-a4bb-4cca-9b5b-047eb461eaf2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.437908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-982d5fa2-a4bb-4cca-9b5b-047eb461eaf2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:29.453811 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2de8234d-5bef-4b09-ba07-ffd3d19b9dce tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:29.461851 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2de8234d-5bef-4b09-ba07-ffd3d19b9dce tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.164267 Jun 15 14:49:29.462439 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 301/609] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:29 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:29.463662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-982d5fa2-a4bb-4cca-9b5b-047eb461eaf2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:49:29.541068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-982d5fa2-a4bb-4cca-9b5b-047eb461eaf2 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 204 len: 0 microversion: 2.1 time: 0.116424 Jun 15 14:49:29.541645 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 309/610] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:49:29 2022] DELETE /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:49:29.550440 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d4924da8-8bf1-4a37-852a-6a6c2c0c8541 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:29.551138 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d4924da8-8bf1-4a37-852a-6a6c2c0c8541 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:29.557155 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4924da8-8bf1-4a37-852a-6a6c2c0c8541 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.557543 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4924da8-8bf1-4a37-852a-6a6c2c0c8541 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:29.558297 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4924da8-8bf1-4a37-852a-6a6c2c0c8541 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.558729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4924da8-8bf1-4a37-852a-6a6c2c0c8541 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:29.688619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d4924da8-8bf1-4a37-852a-6a6c2c0c8541 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:29.696254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d4924da8-8bf1-4a37-852a-6a6c2c0c8541 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1691 microversion: 2.1 time: 0.150317 Jun 15 14:49:29.696826 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 302/611] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:29 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:29.863520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:29.864289 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:29.870368 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.870815 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:29.871621 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:29.872068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:30.009150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:30.018668 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:30.020194 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:30.021699 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e7110fb3-b572-4c10-99cf-3455f584e5ad tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.162585 Jun 15 14:49:30.022256 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 310/612] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:29 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:30.479553 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e7556ad2-a9d3-4ca7-b555-45c6052895e2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:30.480180 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e7556ad2-a9d3-4ca7-b555-45c6052895e2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:30.487350 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7556ad2-a9d3-4ca7-b555-45c6052895e2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:30.487803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7556ad2-a9d3-4ca7-b555-45c6052895e2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:30.488564 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7556ad2-a9d3-4ca7-b555-45c6052895e2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:30.489006 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7556ad2-a9d3-4ca7-b555-45c6052895e2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:30.623897 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e7556ad2-a9d3-4ca7-b555-45c6052895e2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:30.631967 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e7556ad2-a9d3-4ca7-b555-45c6052895e2 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.156292 Jun 15 14:49:30.632540 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 303/613] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:30 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:30.714382 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c0bd330c-d502-4a82-a6f7-276a86e67f16 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:30.715181 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c0bd330c-d502-4a82-a6f7-276a86e67f16 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:30.722224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c0bd330c-d502-4a82-a6f7-276a86e67f16 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:30.722678 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c0bd330c-d502-4a82-a6f7-276a86e67f16 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:30.723457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c0bd330c-d502-4a82-a6f7-276a86e67f16 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:30.723892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c0bd330c-d502-4a82-a6f7-276a86e67f16 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:30.853867 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c0bd330c-d502-4a82-a6f7-276a86e67f16 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:30.862804 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c0bd330c-d502-4a82-a6f7-276a86e67f16 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1691 microversion: 2.1 time: 0.152194 Jun 15 14:49:30.863413 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 311/614] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:30 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:31.039854 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:31.040461 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:31.046411 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.047012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.047665 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.048712 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.177666 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:31.185563 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:31.187086 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:31.188183 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5de92ee0-578e-4c70-8211-46960a0e9bab tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.152342 Jun 15 14:49:31.188754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 304/615] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:31 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:31.649339 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f555f82f-5e07-43e3-9000-a59ff58a522f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:31.649945 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f555f82f-5e07-43e3-9000-a59ff58a522f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:31.657391 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f555f82f-5e07-43e3-9000-a59ff58a522f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.657838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f555f82f-5e07-43e3-9000-a59ff58a522f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.658597 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f555f82f-5e07-43e3-9000-a59ff58a522f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.659046 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f555f82f-5e07-43e3-9000-a59ff58a522f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.792201 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f555f82f-5e07-43e3-9000-a59ff58a522f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:31.801941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f555f82f-5e07-43e3-9000-a59ff58a522f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.156518 Jun 15 14:49:31.802601 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 312/616] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:31 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:31.818089 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:31.818834 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:31.880373 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-79b6b4f2-1095-4be2-ba9e-f31678ffc527 req-4378ae10-4fc6-4132-a556-9449daad3aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00a072c-e13e-4b90-b5f4-7341aea301b7", "name": "network-vif-plugged", "status": "completed", "tag": "5b328c6b-5677-47c6-b09a-974f22b96d56"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:31.881230 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0e52f480-8e5a-4996-954e-df6415eecb14 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:31.881800 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0e52f480-8e5a-4996-954e-df6415eecb14 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:31.884422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:31.888724 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-79b6b4f2-1095-4be2-ba9e-f31678ffc527 req-4378ae10-4fc6-4132-a556-9449daad3aa5 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.889160 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-79b6b4f2-1095-4be2-ba9e-f31678ffc527 req-4378ae10-4fc6-4132-a556-9449daad3aa5 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.890544 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e52f480-8e5a-4996-954e-df6415eecb14 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.891019 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e52f480-8e5a-4996-954e-df6415eecb14 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.891819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e52f480-8e5a-4996-954e-df6415eecb14 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.892259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0e52f480-8e5a-4996-954e-df6415eecb14 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.901626 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-79b6b4f2-1095-4be2-ba9e-f31678ffc527 req-4378ae10-4fc6-4132-a556-9449daad3aa5 service nova] Creating event network-vif-plugged:5b328c6b-5677-47c6-b09a-974f22b96d56 for instance c00a072c-e13e-4b90-b5f4-7341aea301b7 on hv-cinder-80382 Jun 15 14:49:31.906869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-79b6b4f2-1095-4be2-ba9e-f31678ffc527 req-4378ae10-4fc6-4132-a556-9449daad3aa5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094101 Jun 15 14:49:31.907889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 305/617] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:49:32.023277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0e52f480-8e5a-4996-954e-df6415eecb14 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:32.030661 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0e52f480-8e5a-4996-954e-df6415eecb14 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1691 microversion: 2.1 time: 0.153643 Jun 15 14:49:32.031246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 313/618] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:31 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:32.206246 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:32.206982 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:32.213288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:32.213743 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:32.214510 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:32.214955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:32.350118 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:32.358074 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:32.359639 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:32.361375 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-32572a20-6564-46b7-80ae-8ae8135894f0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.159394 Jun 15 14:49:32.361942 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 306/619] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:32 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:32.819465 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f8c9fac4-397a-4bac-8248-f668bc4d19ea tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:32.820071 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f8c9fac4-397a-4bac-8248-f668bc4d19ea tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:32.826472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8c9fac4-397a-4bac-8248-f668bc4d19ea tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:32.826922 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8c9fac4-397a-4bac-8248-f668bc4d19ea tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:32.827726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8c9fac4-397a-4bac-8248-f668bc4d19ea tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:32.828160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8c9fac4-397a-4bac-8248-f668bc4d19ea tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:32.959023 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f8c9fac4-397a-4bac-8248-f668bc4d19ea tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:32.966580 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f8c9fac4-397a-4bac-8248-f668bc4d19ea tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.151162 Jun 15 14:49:32.967176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 314/620] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:32 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:33.047584 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5f5ccf64-fefe-4477-a64b-93cc728a7a5e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:33.048226 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5f5ccf64-fefe-4477-a64b-93cc728a7a5e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:33.054668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf64-fefe-4477-a64b-93cc728a7a5e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:33.055157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf64-fefe-4477-a64b-93cc728a7a5e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:33.055914 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf64-fefe-4477-a64b-93cc728a7a5e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:33.056344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf64-fefe-4477-a64b-93cc728a7a5e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:33.187052 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5f5ccf64-fefe-4477-a64b-93cc728a7a5e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:33.194949 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5f5ccf64-fefe-4477-a64b-93cc728a7a5e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1691 microversion: 2.1 time: 0.151262 Jun 15 14:49:33.195530 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 307/621] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:33 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:33.379087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:33.379645 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:33.385601 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:33.386053 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:33.386809 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:33.387271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:33.527542 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:33.536386 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:33.537912 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:33.539073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a3207f1a-c733-4b02-9225-7c02032c1f02 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.164562 Jun 15 14:49:33.539650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 315/622] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:33 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:33.983977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3314b877-c045-4ae5-a6d1-255267887717 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:33.984508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3314b877-c045-4ae5-a6d1-255267887717 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:33.991227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3314b877-c045-4ae5-a6d1-255267887717 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:33.991678 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3314b877-c045-4ae5-a6d1-255267887717 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:33.992439 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3314b877-c045-4ae5-a6d1-255267887717 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:33.992873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3314b877-c045-4ae5-a6d1-255267887717 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:34.125610 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3314b877-c045-4ae5-a6d1-255267887717 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:34.133508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3314b877-c045-4ae5-a6d1-255267887717 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.153491 Jun 15 14:49:34.134075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 308/623] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:33 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:34.213088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fafb2f71-973c-4eb4-9ae2-792dd12c100d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:34.213675 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fafb2f71-973c-4eb4-9ae2-792dd12c100d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:34.220778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fafb2f71-973c-4eb4-9ae2-792dd12c100d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:34.221228 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fafb2f71-973c-4eb4-9ae2-792dd12c100d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:34.221986 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fafb2f71-973c-4eb4-9ae2-792dd12c100d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:34.222422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fafb2f71-973c-4eb4-9ae2-792dd12c100d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:34.353765 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fafb2f71-973c-4eb4-9ae2-792dd12c100d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:34.362172 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fafb2f71-973c-4eb4-9ae2-792dd12c100d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1691 microversion: 2.1 time: 0.153142 Jun 15 14:49:34.362746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 316/624] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:34 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:34.558072 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:34.559186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:34.566607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:34.567549 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:34.568428 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:34.569083 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:34.818177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:34.826291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:34.827905 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:34.829042 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-efe109ae-b352-4ca4-9a83-1dbdeba09e8e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.274955 Jun 15 14:49:34.835264 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 309/625] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:34 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:35.151733 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d6d2f052-3026-49cc-91a8-6889ca78ec66 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:35.152338 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d6d2f052-3026-49cc-91a8-6889ca78ec66 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:35.158324 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d6d2f052-3026-49cc-91a8-6889ca78ec66 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:35.158767 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d6d2f052-3026-49cc-91a8-6889ca78ec66 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:35.159555 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d6d2f052-3026-49cc-91a8-6889ca78ec66 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:35.160806 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d6d2f052-3026-49cc-91a8-6889ca78ec66 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:35.379621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8a330c13-2e2f-4972-9e3a-f6a76cded7e1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:35.380236 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8a330c13-2e2f-4972-9e3a-f6a76cded7e1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:35.386733 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a330c13-2e2f-4972-9e3a-f6a76cded7e1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:35.387298 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a330c13-2e2f-4972-9e3a-f6a76cded7e1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:35.388061 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a330c13-2e2f-4972-9e3a-f6a76cded7e1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:35.388491 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a330c13-2e2f-4972-9e3a-f6a76cded7e1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:35.393776 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d6d2f052-3026-49cc-91a8-6889ca78ec66 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:35.402639 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d6d2f052-3026-49cc-91a8-6889ca78ec66 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.254752 Jun 15 14:49:35.413274 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 317/626] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:35 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:35.744134 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8a330c13-2e2f-4972-9e3a-f6a76cded7e1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:35.757451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8a330c13-2e2f-4972-9e3a-f6a76cded7e1 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1623 microversion: 2.1 time: 0.382008 Jun 15 14:49:35.758333 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 310/627] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:35 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1623 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:35.831505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-c77be511-84f8-4814-8357-d75cdecdbd57 req-cbe83854-63e6-44d2-a5e0-e8cda3fd5f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32b0d85-8788-4ac8-9e61-faee2f6abee5", "name": "network-vif-unplugged", "status": "completed", "tag": "532f4749-40c3-4e35-839e-07bfc3d097bb"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:35.843294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c77be511-84f8-4814-8357-d75cdecdbd57 req-cbe83854-63e6-44d2-a5e0-e8cda3fd5f8c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:35.849003 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-32e0f5c2-8d65-4468-a7bb-00badf6bdd29 req-d455c1d1-85e2-45f2-8f3f-40086795fa79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fcc60c-8faa-4a1a-9932-9f2daeddaab1", "name": "network-vif-deleted", "tag": "95ee574c-18c1-4dc1-ab0f-7028091804af"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:35.853699 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c77be511-84f8-4814-8357-d75cdecdbd57 req-cbe83854-63e6-44d2-a5e0-e8cda3fd5f8c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:35.859566 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-32e0f5c2-8d65-4468-a7bb-00badf6bdd29 req-d455c1d1-85e2-45f2-8f3f-40086795fa79 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:35.860004 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-32e0f5c2-8d65-4468-a7bb-00badf6bdd29 req-d455c1d1-85e2-45f2-8f3f-40086795fa79 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:35.867025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-c77be511-84f8-4814-8357-d75cdecdbd57 req-cbe83854-63e6-44d2-a5e0-e8cda3fd5f8c service nova] Creating event network-vif-unplugged:532f4749-40c3-4e35-839e-07bfc3d097bb for instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 on hv-cinder-80382 Jun 15 14:49:35.872177 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-c77be511-84f8-4814-8357-d75cdecdbd57 req-cbe83854-63e6-44d2-a5e0-e8cda3fd5f8c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046300 Jun 15 14:49:35.872770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 318/628] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:49:35.873685 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-32e0f5c2-8d65-4468-a7bb-00badf6bdd29 req-d455c1d1-85e2-45f2-8f3f-40086795fa79 service nova] Creating event network-vif-deleted:95ee574c-18c1-4dc1-ab0f-7028091804af for instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 on hv-cinder-80382 Jun 15 14:49:35.878872 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:35.879742 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-32e0f5c2-8d65-4468-a7bb-00badf6bdd29 req-d455c1d1-85e2-45f2-8f3f-40086795fa79 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Jun 15 14:49:35.880348 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:35.880649 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 311/629] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:49:35.887942 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:35.888460 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:35.889307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:35.889806 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:36.025016 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:36.033828 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:36.035922 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:36.037035 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5241a7eb-2ea4-4cd5-883a-323a37bb23c9 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1405 microversion: 2.20 time: 0.162978 Jun 15 14:49:36.037589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 319/630] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:35 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:36.421588 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-19311414-f455-448e-b495-bfe8d91bfc74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:36.422459 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-19311414-f455-448e-b495-bfe8d91bfc74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:36.442137 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19311414-f455-448e-b495-bfe8d91bfc74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:36.443507 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19311414-f455-448e-b495-bfe8d91bfc74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:36.444468 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19311414-f455-448e-b495-bfe8d91bfc74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:36.444913 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19311414-f455-448e-b495-bfe8d91bfc74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:36.584011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-19311414-f455-448e-b495-bfe8d91bfc74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:36.592999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-19311414-f455-448e-b495-bfe8d91bfc74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1509 microversion: 2.1 time: 0.175609 Jun 15 14:49:36.593793 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 312/631] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:36 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:36.610005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-82b393a2-9f49-4b63-96c8-9ee993069ba7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:36.610587 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-82b393a2-9f49-4b63-96c8-9ee993069ba7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:36.616969 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-82b393a2-9f49-4b63-96c8-9ee993069ba7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:36.617415 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-82b393a2-9f49-4b63-96c8-9ee993069ba7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:36.618185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-82b393a2-9f49-4b63-96c8-9ee993069ba7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:36.618618 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-82b393a2-9f49-4b63-96c8-9ee993069ba7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:36.622619 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:36.702726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-82b393a2-9f49-4b63-96c8-9ee993069ba7 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "POST /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5/action" status: 202 len: 0 microversion: 2.1 time: 0.096366 Jun 15 14:49:36.708295 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 320/632] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 14:49:36 2022] POST /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:49:36.713750 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4c3b0a5e-1c3e-488b-8f64-260bb422b8d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:36.714354 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4c3b0a5e-1c3e-488b-8f64-260bb422b8d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:36.720445 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4c3b0a5e-1c3e-488b-8f64-260bb422b8d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:36.720995 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4c3b0a5e-1c3e-488b-8f64-260bb422b8d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:36.721821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4c3b0a5e-1c3e-488b-8f64-260bb422b8d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:36.722289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4c3b0a5e-1c3e-488b-8f64-260bb422b8d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:36.775432 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a1598f46-3d64-4bcd-b89a-37e0b8ed2df7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:36.776326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a1598f46-3d64-4bcd-b89a-37e0b8ed2df7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:36.792667 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a1598f46-3d64-4bcd-b89a-37e0b8ed2df7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:36.793238 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a1598f46-3d64-4bcd-b89a-37e0b8ed2df7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:36.794027 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a1598f46-3d64-4bcd-b89a-37e0b8ed2df7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:36.794952 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a1598f46-3d64-4bcd-b89a-37e0b8ed2df7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:36.895034 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4c3b0a5e-1c3e-488b-8f64-260bb422b8d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:36.913346 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4c3b0a5e-1c3e-488b-8f64-260bb422b8d0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1517 microversion: 2.1 time: 0.195571 Jun 15 14:49:36.914090 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 313/633] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:36 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:36.945336 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a1598f46-3d64-4bcd-b89a-37e0b8ed2df7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:36.955270 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a1598f46-3d64-4bcd-b89a-37e0b8ed2df7 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 200 len: 1331 microversion: 2.1 time: 0.183711 Jun 15 14:49:36.956145 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 321/634] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:36 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 1331 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:37.057777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:37.058380 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:37.065352 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:37.066061 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:37.066844 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:37.067321 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:37.209138 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:37.217792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:37.219316 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:37.220456 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0343b825-f3b7-4d77-bb05-118496e161b4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1597 microversion: 2.20 time: 0.167831 Jun 15 14:49:37.221012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 314/635] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:37 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1597 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:37.238219 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-102ba9b4-a44d-45a4-84ce-5a118313ff9b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:37.238752 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-102ba9b4-a44d-45a4-84ce-5a118313ff9b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:37.245268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-102ba9b4-a44d-45a4-84ce-5a118313ff9b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:37.245719 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-102ba9b4-a44d-45a4-84ce-5a118313ff9b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:37.246494 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-102ba9b4-a44d-45a4-84ce-5a118313ff9b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:37.247138 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-102ba9b4-a44d-45a4-84ce-5a118313ff9b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:37.327198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-102ba9b4-a44d-45a4-84ce-5a118313ff9b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093278 Jun 15 14:49:37.327810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 322/636] 10.222.0.45 () {60 vars in 1315 bytes} [Wed Jun 15 14:49:37 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:49:37.931167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e54e3515-fcc6-447c-a705-43651eadaa4f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:37.931953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e54e3515-fcc6-447c-a705-43651eadaa4f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:37.938682 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e54e3515-fcc6-447c-a705-43651eadaa4f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:37.939177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e54e3515-fcc6-447c-a705-43651eadaa4f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:37.939953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e54e3515-fcc6-447c-a705-43651eadaa4f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:37.940390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e54e3515-fcc6-447c-a705-43651eadaa4f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:37.975022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:37.976563 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: e9fcc60c-8faa-4a1a-9932-9f2daeddaab1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:37.990291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:37.990843 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:37.991939 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:37.992692 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:38.010117 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] HTTP exception thrown: Instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 could not be found. Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Request method failure captured: Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 HTTP/1.1 Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_vsVqv8zUDcLKMkhdoSOpO9htG3cYnqBij9rB1tU7ynIU2RsJHWW_IP3iTlvQft_XZa9z7dM3OLaNszoULmQUE0zyL6IuFGcqtfp3avZQMZBldLZHkPHo3rjPYQhcGCfpcRu9dAVIf-d0rmTUS3-vulsb_yBx9vHIMIetjdvoFbwA Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:49:38.012345 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a243ba2c3f774c10b77a052075497b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: c9a3a2e49fee4ea08ca790006d0b29e4 Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 could not be found. Jun 15 14:49:38.014525 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': 'e9fcc60c-8faa-4a1a-9932-9f2daeddaab1'} Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 could not be found. Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:38.015472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 could not be found. Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 could not be found. Jun 15 14:49:38.017728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:38.019435 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Returning 404 to user: Instance e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:38.019435 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-dc5e2d4c-3c14-4c11-9db2-4275bc3bd2d8 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1" status: 404 len: 111 microversion: 2.1 time: 0.046216 Jun 15 14:49:38.022024 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 323/637] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:37 2022] GET /compute/v2.1/servers/e9fcc60c-8faa-4a1a-9932-9f2daeddaab1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:49:38.028088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1438b724-7cc3-4d2d-9254-7b8c578144dc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '.version_select at 0x7f05b771fd30>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:38.042457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:38.052569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1438b724-7cc3-4d2d-9254-7b8c578144dc tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038535616" status: 202 len: 0 microversion: 2.1 time: 0.029310 Jun 15 14:49:38.053140 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 324/638] 10.222.0.45 () {58 vars in 1220 bytes} [Wed Jun 15 14:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038535616 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:49:38.118536 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e54e3515-fcc6-447c-a705-43651eadaa4f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:38.126742 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e54e3515-fcc6-447c-a705-43651eadaa4f tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1519 microversion: 2.1 time: 0.199749 Jun 15 14:49:38.131218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 315/639] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:37 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:38.993307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-6b341ae6-5f86-46af-b96e-7da9bcf457a7 req-f0cfac50-bce1-4ef1-856e-8e8575d6a66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00a072c-e13e-4b90-b5f4-7341aea301b7", "tag": "5b328c6b-5677-47c6-b09a-974f22b96d56"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:39.002856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-6b341ae6-5f86-46af-b96e-7da9bcf457a7 req-f0cfac50-bce1-4ef1-856e-8e8575d6a66a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:39.010145 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-6b341ae6-5f86-46af-b96e-7da9bcf457a7 req-f0cfac50-bce1-4ef1-856e-8e8575d6a66a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:39.027914 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-6b341ae6-5f86-46af-b96e-7da9bcf457a7 req-f0cfac50-bce1-4ef1-856e-8e8575d6a66a service nova] Creating event network-changed:5b328c6b-5677-47c6-b09a-974f22b96d56 for instance c00a072c-e13e-4b90-b5f4-7341aea301b7 on hv-cinder-80382 Jun 15 14:49:39.035914 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-6b341ae6-5f86-46af-b96e-7da9bcf457a7 req-f0cfac50-bce1-4ef1-856e-8e8575d6a66a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046977 Jun 15 14:49:39.036521 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 325/640] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:39.148418 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b4d69fa9-4500-4795-8e4e-6b5f730472bb tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:39.150698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b4d69fa9-4500-4795-8e4e-6b5f730472bb tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:39.160512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4d69fa9-4500-4795-8e4e-6b5f730472bb tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:39.160977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4d69fa9-4500-4795-8e4e-6b5f730472bb tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:39.162281 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4d69fa9-4500-4795-8e4e-6b5f730472bb tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:39.163253 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4d69fa9-4500-4795-8e4e-6b5f730472bb tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:39.403313 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b4d69fa9-4500-4795-8e4e-6b5f730472bb tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:39.413859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b4d69fa9-4500-4795-8e4e-6b5f730472bb tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.271272 Jun 15 14:49:39.415312 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 316/641] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:39 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:40.432486 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3db896d4-8f62-4236-b28f-c2dc37d62481 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:40.433231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3db896d4-8f62-4236-b28f-c2dc37d62481 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:40.441509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3db896d4-8f62-4236-b28f-c2dc37d62481 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:40.442142 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3db896d4-8f62-4236-b28f-c2dc37d62481 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:40.443025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3db896d4-8f62-4236-b28f-c2dc37d62481 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:40.443545 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3db896d4-8f62-4236-b28f-c2dc37d62481 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:40.582141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3db896d4-8f62-4236-b28f-c2dc37d62481 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:40.591526 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3db896d4-8f62-4236-b28f-c2dc37d62481 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.164432 Jun 15 14:49:40.592190 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 326/642] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:40 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:41.491757 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-67b177f4-b434-4f94-94b6-e0141ec38912 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:41.492260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-67b177f4-b434-4f94-94b6-e0141ec38912 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:41.498647 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-67b177f4-b434-4f94-94b6-e0141ec38912 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:41.499135 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-67b177f4-b434-4f94-94b6-e0141ec38912 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:41.499884 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-67b177f4-b434-4f94-94b6-e0141ec38912 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:41.500310 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-67b177f4-b434-4f94-94b6-e0141ec38912 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:41.525373 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-67b177f4-b434-4f94-94b6-e0141ec38912 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:49:41.528151 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:41.590180 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:41.611861 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b4176ab0-12b6-4c5c-9835-e3ce9aab7cb3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:41.612658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b4176ab0-12b6-4c5c-9835-e3ce9aab7cb3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:41.621065 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-67b177f4-b434-4f94-94b6-e0141ec38912 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 204 len: 0 microversion: 2.1 time: 0.132855 Jun 15 14:49:41.621298 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b4176ab0-12b6-4c5c-9835-e3ce9aab7cb3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:41.621651 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 317/643] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:49:41 2022] DELETE /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:49:41.621749 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b4176ab0-12b6-4c5c-9835-e3ce9aab7cb3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:41.622634 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b4176ab0-12b6-4c5c-9835-e3ce9aab7cb3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:41.623128 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b4176ab0-12b6-4c5c-9835-e3ce9aab7cb3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:41.630336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9464a49a-ff69-4c74-be84-7fb13df2716d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:41.631050 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9464a49a-ff69-4c74-be84-7fb13df2716d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:41.636877 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9464a49a-ff69-4c74-be84-7fb13df2716d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:41.637322 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9464a49a-ff69-4c74-be84-7fb13df2716d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:41.638085 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9464a49a-ff69-4c74-be84-7fb13df2716d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:41.638519 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9464a49a-ff69-4c74-be84-7fb13df2716d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:41.818521 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b4176ab0-12b6-4c5c-9835-e3ce9aab7cb3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:41.826107 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b4176ab0-12b6-4c5c-9835-e3ce9aab7cb3 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.220484 Jun 15 14:49:41.826684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 327/644] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:41 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:41.834327 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9464a49a-ff69-4c74-be84-7fb13df2716d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:41.841978 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9464a49a-ff69-4c74-be84-7fb13df2716d tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1507 microversion: 2.1 time: 0.216135 Jun 15 14:49:41.842540 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 318/645] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:41 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:42.843387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-99a35838-100b-4e58-bfd6-d56757a64a3e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:42.843988 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-99a35838-100b-4e58-bfd6-d56757a64a3e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:42.850744 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-99a35838-100b-4e58-bfd6-d56757a64a3e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:42.851236 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-99a35838-100b-4e58-bfd6-d56757a64a3e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:42.852002 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-99a35838-100b-4e58-bfd6-d56757a64a3e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:42.852443 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-99a35838-100b-4e58-bfd6-d56757a64a3e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:42.859017 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a18570f6-ac7e-4120-9ab5-f65ab1d7c536 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:42.859635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a18570f6-ac7e-4120-9ab5-f65ab1d7c536 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:42.866600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a18570f6-ac7e-4120-9ab5-f65ab1d7c536 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:42.867081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a18570f6-ac7e-4120-9ab5-f65ab1d7c536 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:42.867859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a18570f6-ac7e-4120-9ab5-f65ab1d7c536 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:42.868292 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a18570f6-ac7e-4120-9ab5-f65ab1d7c536 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.050480 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-99a35838-100b-4e58-bfd6-d56757a64a3e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:43.054660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a18570f6-ac7e-4120-9ab5-f65ab1d7c536 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:43.058124 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-99a35838-100b-4e58-bfd6-d56757a64a3e tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.218581 Jun 15 14:49:43.058695 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 328/646] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:42 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:43.062201 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a18570f6-ac7e-4120-9ab5-f65ab1d7c536 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1507 microversion: 2.1 time: 0.207063 Jun 15 14:49:43.062773 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 319/647] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:42 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:43.607946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4df9efe1-bb49-469f-ac08-f73968a1c3d4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:43.608869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4df9efe1-bb49-469f-ac08-f73968a1c3d4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:43.616278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4df9efe1-bb49-469f-ac08-f73968a1c3d4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:43.616738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4df9efe1-bb49-469f-ac08-f73968a1c3d4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.617554 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4df9efe1-bb49-469f-ac08-f73968a1c3d4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:43.617993 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4df9efe1-bb49-469f-ac08-f73968a1c3d4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.649851 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4df9efe1-bb49-469f-ac08-f73968a1c3d4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045735 Jun 15 14:49:43.650410 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 329/648] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:43 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:49:43.711130 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f71951ce-6422-4446-8981-9fee11552f00 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:43.711730 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f71951ce-6422-4446-8981-9fee11552f00 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:43.718141 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f71951ce-6422-4446-8981-9fee11552f00 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:43.718592 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f71951ce-6422-4446-8981-9fee11552f00 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.719386 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f71951ce-6422-4446-8981-9fee11552f00 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:43.720438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f71951ce-6422-4446-8981-9fee11552f00 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.746826 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f71951ce-6422-4446-8981-9fee11552f00 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:49:43.825506 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f71951ce-6422-4446-8981-9fee11552f00 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "DELETE /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 204 len: 0 microversion: 2.1 time: 0.117980 Jun 15 14:49:43.826095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 320/649] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:49:43 2022] DELETE /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:49:43.836650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-087ae8eb-8fa3-4843-85cc-36deb4c3a24a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:43.837275 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-087ae8eb-8fa3-4843-85cc-36deb4c3a24a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:43.843933 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-087ae8eb-8fa3-4843-85cc-36deb4c3a24a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:43.844589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-087ae8eb-8fa3-4843-85cc-36deb4c3a24a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.845368 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-087ae8eb-8fa3-4843-85cc-36deb4c3a24a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:43.846050 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-087ae8eb-8fa3-4843-85cc-36deb4c3a24a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.929736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-372a452c-1492-4223-b956-609c2599e46b req-b46904f2-e138-4e24-baef-ae0e95d8d0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d16976b-b746-452b-b48d-b7a26950a19e", "name": "network-vif-deleted", "tag": "24f578b6-7f09-4add-8d9b-74b34e954ebf"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:43.940661 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-372a452c-1492-4223-b956-609c2599e46b req-b46904f2-e138-4e24-baef-ae0e95d8d0fb service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:43.941489 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-372a452c-1492-4223-b956-609c2599e46b req-b46904f2-e138-4e24-baef-ae0e95d8d0fb service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.954043 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-372a452c-1492-4223-b956-609c2599e46b req-b46904f2-e138-4e24-baef-ae0e95d8d0fb service nova] Creating event network-vif-deleted:24f578b6-7f09-4add-8d9b-74b34e954ebf for instance 1d16976b-b746-452b-b48d-b7a26950a19e on hv-cinder-80382 Jun 15 14:49:43.959476 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-372a452c-1492-4223-b956-609c2599e46b req-b46904f2-e138-4e24-baef-ae0e95d8d0fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034212 Jun 15 14:49:43.960130 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 321/650] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:44.001394 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-087ae8eb-8fa3-4843-85cc-36deb4c3a24a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:44.009460 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-087ae8eb-8fa3-4843-85cc-36deb4c3a24a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1673 microversion: 2.1 time: 0.177373 Jun 15 14:49:44.010838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 330/651] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:43 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:44.075455 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c81b9297-3d87-4e36-8701-726fd70ca413 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:44.076269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c81b9297-3d87-4e36-8701-726fd70ca413 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:44.079438 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-098e0654-3f34-45d5-b2dc-21f343446ffd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:44.080173 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-098e0654-3f34-45d5-b2dc-21f343446ffd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:44.082664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c81b9297-3d87-4e36-8701-726fd70ca413 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.083143 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c81b9297-3d87-4e36-8701-726fd70ca413 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.083903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c81b9297-3d87-4e36-8701-726fd70ca413 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.084332 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c81b9297-3d87-4e36-8701-726fd70ca413 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.086380 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-098e0654-3f34-45d5-b2dc-21f343446ffd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.086901 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-098e0654-3f34-45d5-b2dc-21f343446ffd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.087764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-098e0654-3f34-45d5-b2dc-21f343446ffd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.088206 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-098e0654-3f34-45d5-b2dc-21f343446ffd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.176400 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-098e0654-3f34-45d5-b2dc-21f343446ffd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:44.185175 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-098e0654-3f34-45d5-b2dc-21f343446ffd tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1465 microversion: 2.1 time: 0.109916 Jun 15 14:49:44.185758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 331/652] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:44 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1465 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:44.258917 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c81b9297-3d87-4e36-8701-726fd70ca413 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:44.266738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c81b9297-3d87-4e36-8701-726fd70ca413 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.195438 Jun 15 14:49:44.267405 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 322/653] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:44 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:45.027943 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e973f29d-5fd8-42c9-9f1a-4ded9226fa21 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:45.028478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e973f29d-5fd8-42c9-9f1a-4ded9226fa21 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:45.035222 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e973f29d-5fd8-42c9-9f1a-4ded9226fa21 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:45.036020 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e973f29d-5fd8-42c9-9f1a-4ded9226fa21 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:45.036791 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e973f29d-5fd8-42c9-9f1a-4ded9226fa21 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:45.037252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e973f29d-5fd8-42c9-9f1a-4ded9226fa21 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:45.167848 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e973f29d-5fd8-42c9-9f1a-4ded9226fa21 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:45.175690 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e973f29d-5fd8-42c9-9f1a-4ded9226fa21 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1673 microversion: 2.1 time: 0.151676 Jun 15 14:49:45.176275 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 332/654] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:45 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:45.203387 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:45.204654 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:45.211508 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:45.211965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:45.212954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:45.213487 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:45.244797 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:45.245278 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:45.245729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lazy-loading 'fault' on Instance uuid 1d16976b-b746-452b-b48d-b7a26950a19e {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:45.283892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7dee467c-d5b2-44f8-9f0c-d2bb2225e942 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:45.284415 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7dee467c-d5b2-44f8-9f0c-d2bb2225e942 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:45.287500 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:45.290764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7dee467c-d5b2-44f8-9f0c-d2bb2225e942 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:45.291352 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7dee467c-d5b2-44f8-9f0c-d2bb2225e942 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:45.292211 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7dee467c-d5b2-44f8-9f0c-d2bb2225e942 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:45.292719 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7dee467c-d5b2-44f8-9f0c-d2bb2225e942 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:45.294937 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a0e37864-d3f4-4a92-9bda-f26b04190037 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1310 microversion: 2.1 time: 0.095431 Jun 15 14:49:45.295545 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 323/655] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:45 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:45.432977 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7dee467c-d5b2-44f8-9f0c-d2bb2225e942 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:45.441242 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7dee467c-d5b2-44f8-9f0c-d2bb2225e942 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.161265 Jun 15 14:49:45.441875 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 333/656] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:45 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:46.192882 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2df914cc-330c-4444-829c-64503f89293f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:46.193486 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2df914cc-330c-4444-829c-64503f89293f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:46.199519 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2df914cc-330c-4444-829c-64503f89293f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:46.199966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2df914cc-330c-4444-829c-64503f89293f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:46.200723 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2df914cc-330c-4444-829c-64503f89293f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:46.201154 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2df914cc-330c-4444-829c-64503f89293f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:46.312816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:46.313428 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:46.320062 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:46.320523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:46.321370 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:46.321746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:46.338401 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2df914cc-330c-4444-829c-64503f89293f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:46.346674 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2df914cc-330c-4444-829c-64503f89293f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1673 microversion: 2.1 time: 0.157644 Jun 15 14:49:46.347288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 324/657] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:46 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:46.354635 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:46.355127 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:46.355577 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lazy-loading 'fault' on Instance uuid 1d16976b-b746-452b-b48d-b7a26950a19e {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:46.399673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:46.407641 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9299b2c0-5c9b-4d86-8eee-6e17432d41b5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 200 len: 1310 microversion: 2.1 time: 0.098051 Jun 15 14:49:46.408571 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 334/658] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:46 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:46.458857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9eb058ef-fe8e-46ff-bc7f-3eec42a39133 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:46.459408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9eb058ef-fe8e-46ff-bc7f-3eec42a39133 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:46.465519 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9eb058ef-fe8e-46ff-bc7f-3eec42a39133 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:46.465969 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9eb058ef-fe8e-46ff-bc7f-3eec42a39133 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:46.466736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9eb058ef-fe8e-46ff-bc7f-3eec42a39133 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:46.467206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9eb058ef-fe8e-46ff-bc7f-3eec42a39133 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:46.622106 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9eb058ef-fe8e-46ff-bc7f-3eec42a39133 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:46.630227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9eb058ef-fe8e-46ff-bc7f-3eec42a39133 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.175719 Jun 15 14:49:46.630795 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 325/659] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:46 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:47.262102 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-c887adff-d20f-4077-aff9-01b24e4207c7 req-566a8b17-68d8-484c-847f-e3a004bbb848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992c4ee6-083c-4194-adff-7bf50b93e91c", "name": "network-vif-deleted", "tag": "949f1732-468d-4323-8ec1-88c3490ca899"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:47.270532 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c887adff-d20f-4077-aff9-01b24e4207c7 req-566a8b17-68d8-484c-847f-e3a004bbb848 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.270973 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c887adff-d20f-4077-aff9-01b24e4207c7 req-566a8b17-68d8-484c-847f-e3a004bbb848 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.281892 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-c887adff-d20f-4077-aff9-01b24e4207c7 req-566a8b17-68d8-484c-847f-e3a004bbb848 service nova] Creating event network-vif-deleted:949f1732-468d-4323-8ec1-88c3490ca899 for instance 992c4ee6-083c-4194-adff-7bf50b93e91c on hv-cinder-80382 Jun 15 14:49:47.287873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-c887adff-d20f-4077-aff9-01b24e4207c7 req-566a8b17-68d8-484c-847f-e3a004bbb848 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029373 Jun 15 14:49:47.288879 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 335/660] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:47.365235 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-16003ed7-7184-4dd1-8d8d-7c3c4897bfcf tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:47.365738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-16003ed7-7184-4dd1-8d8d-7c3c4897bfcf tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:47.373069 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-16003ed7-7184-4dd1-8d8d-7c3c4897bfcf tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.379492 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-16003ed7-7184-4dd1-8d8d-7c3c4897bfcf tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.380099 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-16003ed7-7184-4dd1-8d8d-7c3c4897bfcf tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.380535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-16003ed7-7184-4dd1-8d8d-7c3c4897bfcf tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.425648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:47.427026 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: 1d16976b-b746-452b-b48d-b7a26950a19e] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:47.442362 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.443724 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.444814 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.445419 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.460582 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-16003ed7-7184-4dd1-8d8d-7c3c4897bfcf tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:47.465119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] HTTP exception thrown: Instance 1d16976b-b746-452b-b48d-b7a26950a19e could not be found. Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Request method failure captured: Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e HTTP/1.1 Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_vsVqv8zUDcLKMkhdoSOpO9htG3cYnqBij9rB1tU7ynIU2RsJHWW_IP3iTlvQft_XZa9z7dM3OLaNszoULmQUE0zyL6IuFGcqtfp3avZQMZBldLZHkPHo3rjPYQhcGCfpcRu9dAVIf-d0rmTUS3-vulsb_yBx9vHIMIetjdvoFbwA Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:49:47.466883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a243ba2c3f774c10b77a052075497b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: c9a3a2e49fee4ea08ca790006d0b29e4 Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 1d16976b-b746-452b-b48d-b7a26950a19e could not be found. Jun 15 14:49:47.468160 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '1d16976b-b746-452b-b48d-b7a26950a19e'} Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d16976b-b746-452b-b48d-b7a26950a19e could not be found. Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:47.468880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d16976b-b746-452b-b48d-b7a26950a19e could not be found. Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d16976b-b746-452b-b48d-b7a26950a19e could not be found. Jun 15 14:49:47.470291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:47.472869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Returning 404 to user: Instance 1d16976b-b746-452b-b48d-b7a26950a19e could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:47.472869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d9c59f5a-fea4-436b-94c0-4c4f4ead401e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e" status: 404 len: 111 microversion: 2.1 time: 0.047160 Jun 15 14:49:47.472869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 336/661] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:47 2022] GET /compute/v2.1/servers/1d16976b-b746-452b-b48d-b7a26950a19e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:49:47.477444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-16003ed7-7184-4dd1-8d8d-7c3c4897bfcf tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1605 microversion: 2.1 time: 0.117392 Jun 15 14:49:47.478587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 326/662] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:47 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1605 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:47.486795 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-655fc06d-e039-489f-8577-38a4245b6337 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:47.487658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-655fc06d-e039-489f-8577-38a4245b6337 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:47.496780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-655fc06d-e039-489f-8577-38a4245b6337 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.503141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-655fc06d-e039-489f-8577-38a4245b6337 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.504480 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-655fc06d-e039-489f-8577-38a4245b6337 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.505287 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-655fc06d-e039-489f-8577-38a4245b6337 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.533437 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-655fc06d-e039-489f-8577-38a4245b6337 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:49:47.588853 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:47.622266 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-655fc06d-e039-489f-8577-38a4245b6337 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 204 len: 0 microversion: 2.1 time: 0.148101 Jun 15 14:49:47.622844 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 337/663] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:49:47 2022] DELETE /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 14:49:47.632362 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3a974975-5735-46e1-831f-10ec54c6d2fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:47.632971 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3a974975-5735-46e1-831f-10ec54c6d2fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:47.639622 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3a974975-5735-46e1-831f-10ec54c6d2fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.640393 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3a974975-5735-46e1-831f-10ec54c6d2fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.642605 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3a974975-5735-46e1-831f-10ec54c6d2fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.642605 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3a974975-5735-46e1-831f-10ec54c6d2fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.652987 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6e068743-74d0-42fb-bd15-50504d5a6621 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:47.654168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6e068743-74d0-42fb-bd15-50504d5a6621 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:47.662081 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e068743-74d0-42fb-bd15-50504d5a6621 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.662537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e068743-74d0-42fb-bd15-50504d5a6621 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.664294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e068743-74d0-42fb-bd15-50504d5a6621 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.664294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e068743-74d0-42fb-bd15-50504d5a6621 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.845910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3a974975-5735-46e1-831f-10ec54c6d2fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:47.854544 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3a974975-5735-46e1-831f-10ec54c6d2fb tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.226395 Jun 15 14:49:47.855354 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 327/664] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:47 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:47.866028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6e068743-74d0-42fb-bd15-50504d5a6621 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:47.873767 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6e068743-74d0-42fb-bd15-50504d5a6621 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.225587 Jun 15 14:49:47.874521 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 338/665] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:47 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:48.494804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:48.495456 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:48.502011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:48.502445 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:48.503223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:48.503651 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:48.537786 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:48.538144 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:48.538596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lazy-loading 'fault' on Instance uuid 992c4ee6-083c-4194-adff-7bf50b93e91c {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:48.578507 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:48.586618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-83094710-6d99-44c0-8684-1d463cdb5740 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1326 microversion: 2.1 time: 0.095598 Jun 15 14:49:48.587234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 328/666] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:48 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:48.872415 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-388bc291-a19c-4197-a7e3-7f1d8c22237e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:48.873021 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-388bc291-a19c-4197-a7e3-7f1d8c22237e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:48.880234 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-388bc291-a19c-4197-a7e3-7f1d8c22237e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:48.880682 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-388bc291-a19c-4197-a7e3-7f1d8c22237e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:48.881453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-388bc291-a19c-4197-a7e3-7f1d8c22237e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:48.881912 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-388bc291-a19c-4197-a7e3-7f1d8c22237e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:48.892668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-31511148-701c-4157-bf19-ee2b04b23773 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:48.893548 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-31511148-701c-4157-bf19-ee2b04b23773 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:48.899878 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31511148-701c-4157-bf19-ee2b04b23773 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:48.900424 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31511148-701c-4157-bf19-ee2b04b23773 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:48.901451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31511148-701c-4157-bf19-ee2b04b23773 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:48.901969 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31511148-701c-4157-bf19-ee2b04b23773 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.065770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-388bc291-a19c-4197-a7e3-7f1d8c22237e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:49.074216 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-388bc291-a19c-4197-a7e3-7f1d8c22237e tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.205750 Jun 15 14:49:49.074776 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 339/667] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:48 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:49.097764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-31511148-701c-4157-bf19-ee2b04b23773 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:49.105202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-31511148-701c-4157-bf19-ee2b04b23773 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.217176 Jun 15 14:49:49.105760 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 329/668] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:48 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:49.605095 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:49.605697 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:49.612374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.612817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.613566 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.613993 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.643497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.643929 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.644365 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lazy-loading 'fault' on Instance uuid 992c4ee6-083c-4194-adff-7bf50b93e91c {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:49.687367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:49.694775 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3513b02b-42eb-456c-b499-a6f33ea50377 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 200 len: 1326 microversion: 2.1 time: 0.093503 Jun 15 14:49:49.695367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 340/669] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:49 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:49.918296 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-8e320e9e-3c33-4f1a-b55f-cc4243400e98 req-1fd2422b-9e0f-4cdb-9f8f-78346a702094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32b0d85-8788-4ac8-9e61-faee2f6abee5", "name": "network-vif-plugged", "status": "completed", "tag": "532f4749-40c3-4e35-839e-07bfc3d097bb"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:49.927706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8e320e9e-3c33-4f1a-b55f-cc4243400e98 req-1fd2422b-9e0f-4cdb-9f8f-78346a702094 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.928158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8e320e9e-3c33-4f1a-b55f-cc4243400e98 req-1fd2422b-9e0f-4cdb-9f8f-78346a702094 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.939666 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-8e320e9e-3c33-4f1a-b55f-cc4243400e98 req-1fd2422b-9e0f-4cdb-9f8f-78346a702094 service nova] Creating event network-vif-plugged:532f4749-40c3-4e35-839e-07bfc3d097bb for instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 on hv-cinder-80382 Jun 15 14:49:49.944679 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-8e320e9e-3c33-4f1a-b55f-cc4243400e98 req-1fd2422b-9e0f-4cdb-9f8f-78346a702094 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030074 Jun 15 14:49:49.945308 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 330/670] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:50.091088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7d1e139b-b306-42e7-976f-162418fe73a4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:50.091693 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7d1e139b-b306-42e7-976f-162418fe73a4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:50.099752 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7d1e139b-b306-42e7-976f-162418fe73a4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.100203 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7d1e139b-b306-42e7-976f-162418fe73a4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.100965 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7d1e139b-b306-42e7-976f-162418fe73a4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.101397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7d1e139b-b306-42e7-976f-162418fe73a4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.123132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-573dfa55-cb5f-475f-800d-de9f91f31123 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:50.123955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-573dfa55-cb5f-475f-800d-de9f91f31123 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:50.130753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-573dfa55-cb5f-475f-800d-de9f91f31123 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.131231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-573dfa55-cb5f-475f-800d-de9f91f31123 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.132222 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-573dfa55-cb5f-475f-800d-de9f91f31123 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.132689 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-573dfa55-cb5f-475f-800d-de9f91f31123 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.286596 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7d1e139b-b306-42e7-976f-162418fe73a4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:50.293971 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7d1e139b-b306-42e7-976f-162418fe73a4 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1522 microversion: 2.1 time: 0.206754 Jun 15 14:49:50.294531 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 341/671] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:50 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:50.316120 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-573dfa55-cb5f-475f-800d-de9f91f31123 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:50.319644 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:50.324324 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-573dfa55-cb5f-475f-800d-de9f91f31123 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.205422 Jun 15 14:49:50.324887 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 331/672] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:50 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:50.713755 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:50.714376 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:50.727983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.728634 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.729457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.729890 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.745764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] HTTP exception thrown: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Request method failure captured: Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c HTTP/1.1 Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_xFdwFsqv3FK89kRl4PykrTW20fdrlQjVV8tsSasc6cRQb2zMIKlvmcE_Oh2YddlKGogHNrn1Y9-eVMkJrJsxMGaW5eJTOzsy0dN2wNxnWOXY6TMxeNiIOHp7YhAfitIGoLf-a0-NUGlNTMHzqFOH6B4Vc-FSbhMxgeQvYecidDPw Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:49:50.747704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1efb0951ba1144d58698e02e0e5e9416 Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:49:50.749325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '992c4ee6-083c-4194-adff-7bf50b93e91c'} Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:50.750265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:49:50.752490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:49:50.753894 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Returning 404 to user: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:50.753894 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a0cadf97-4cf0-4d1f-9d11-9bdf3c07e232 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 404 len: 111 microversion: 2.1 time: 0.043900 Jun 15 14:49:50.754708 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 342/673] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:50 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:49:50.764350 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b95f5d3c-bc23-4e7a-b0cf-ffc0bba525d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '.version_select at 0x7f05b7601790>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:50.790949 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b95f5d3c-bc23-4e7a-b0cf-ffc0bba525d7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-790703021" status: 202 len: 0 microversion: 2.1 time: 0.031002 Jun 15 14:49:50.792062 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 332/674] 10.222.0.45 () {58 vars in 1217 bytes} [Wed Jun 15 14:49:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-790703021 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:49:51.185228 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-b1e654f1-6db0-40af-a42f-4f71ec1eea33 req-0960d3fd-8021-44c8-b03b-6ae1d468126c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66", "name": "network-vif-deleted", "tag": "0a0e535f-062d-49cb-ba26-271db8cdd8d9"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:51.194431 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b1e654f1-6db0-40af-a42f-4f71ec1eea33 req-0960d3fd-8021-44c8-b03b-6ae1d468126c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.194882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b1e654f1-6db0-40af-a42f-4f71ec1eea33 req-0960d3fd-8021-44c8-b03b-6ae1d468126c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.206814 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-b1e654f1-6db0-40af-a42f-4f71ec1eea33 req-0960d3fd-8021-44c8-b03b-6ae1d468126c service nova] Creating event network-vif-deleted:0a0e535f-062d-49cb-ba26-271db8cdd8d9 for instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 on hv-cinder-80382 Jun 15 14:49:51.212104 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-b1e654f1-6db0-40af-a42f-4f71ec1eea33 req-0960d3fd-8021-44c8-b03b-6ae1d468126c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031196 Jun 15 14:49:51.213028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 343/675] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:51.311498 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e441abea-5474-4302-8c6c-422d832510a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:51.312328 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e441abea-5474-4302-8c6c-422d832510a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:51.319043 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e441abea-5474-4302-8c6c-422d832510a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.319494 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e441abea-5474-4302-8c6c-422d832510a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.320254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e441abea-5474-4302-8c6c-422d832510a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.320686 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e441abea-5474-4302-8c6c-422d832510a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.342910 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-af74303e-8603-4efd-b49c-6bba737e1cb5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:51.343658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-af74303e-8603-4efd-b49c-6bba737e1cb5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:51.351360 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-af74303e-8603-4efd-b49c-6bba737e1cb5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.352252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-af74303e-8603-4efd-b49c-6bba737e1cb5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.353033 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-af74303e-8603-4efd-b49c-6bba737e1cb5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.353468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-af74303e-8603-4efd-b49c-6bba737e1cb5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.410365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e441abea-5474-4302-8c6c-422d832510a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:51.417941 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e441abea-5474-4302-8c6c-422d832510a5 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1307 microversion: 2.1 time: 0.110643 Jun 15 14:49:51.418528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 333/676] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:51 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:51.526080 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-af74303e-8603-4efd-b49c-6bba737e1cb5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:51.535967 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-af74303e-8603-4efd-b49c-6bba737e1cb5 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1575 microversion: 2.1 time: 0.197728 Jun 15 14:49:51.545612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 344/677] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:51 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:51.666614 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-025a11b0-554d-41fd-843a-60a1f8422025 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'create', calling method: .version_select at 0x7f05b7712a60>, body: {"keypair": {"name": "tempest-keypair-1557763080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1JrJTS2iEC3IZ1foOx+8Y2jKtyfRTsh3HV6H2Qe8rhBO4v2len4P49Cu0AoiEzA7/0AiY4Iy6mgWK68GtOUNsXxWSs4Ft9fGDIWUTU1YYKF0hz8ZxuoKLvNm8Aaiu0Zw=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:51.680753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-025a11b0-554d-41fd-843a-60a1f8422025 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Getting quotas for project 6d3ce7cecd2f4983b8442f70ed2afdb1. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:49:51.684907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-025a11b0-554d-41fd-843a-60a1f8422025 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Getting quotas for user 1efb0951ba1144d58698e02e0e5e9416 and project 6d3ce7cecd2f4983b8442f70ed2afdb1. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:49:51.709273 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-025a11b0-554d-41fd-843a-60a1f8422025 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046519 Jun 15 14:49:51.709882 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 334/678] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 14:49:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:52.435133 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:52.435751 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:52.443284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:52.443985 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:52.444926 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:52.445556 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:52.482666 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:52.483142 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:52.483599 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lazy-loading 'fault' on Instance uuid c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:52.554460 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0027553d-3d0c-41f2-ae35-f8b05c9f37e0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:52.555102 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0027553d-3d0c-41f2-ae35-f8b05c9f37e0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:52.561124 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0027553d-3d0c-41f2-ae35-f8b05c9f37e0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:52.561573 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0027553d-3d0c-41f2-ae35-f8b05c9f37e0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:52.562471 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0027553d-3d0c-41f2-ae35-f8b05c9f37e0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:52.562785 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0027553d-3d0c-41f2-ae35-f8b05c9f37e0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:52.563472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a3a2e49fee4ea08ca790006d0b29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a243ba2c3f774c10b77a052075497b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:52.571874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-49e5d96e-f24d-4e33-866e-49b95fbdd000 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 200 len: 1312 microversion: 2.1 time: 0.140510 Jun 15 14:49:52.572654 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 345/679] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:52 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:52.782137 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0027553d-3d0c-41f2-ae35-f8b05c9f37e0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:52.795024 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0027553d-3d0c-41f2-ae35-f8b05c9f37e0 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1562 microversion: 2.1 time: 0.245274 Jun 15 14:49:52.796056 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 335/680] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:52 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1562 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:53.117852 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1091501852", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23f2c458-8df1-4b42-a46b-d86f08ca6185"}], "security_groups": [{"name": "tempest-securitygroup--1046948441"}], "key_name": "tempest-keypair-1557763080", "user_data": "}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:53.221490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] validate_networks() for [('23f2c458-8df1-4b42-a46b-d86f08ca6185', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:49:53.590426 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:53.591238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] [instance: c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:53.599473 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:53.599926 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:53.600709 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:53.601146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:53.615259 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] HTTP exception thrown: Instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 could not be found. Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Request method failure captured: Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 HTTP/1.1 Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_vsVqv8zUDcLKMkhdoSOpO9htG3cYnqBij9rB1tU7ynIU2RsJHWW_IP3iTlvQft_XZa9z7dM3OLaNszoULmQUE0zyL6IuFGcqtfp3avZQMZBldLZHkPHo3rjPYQhcGCfpcRu9dAVIf-d0rmTUS3-vulsb_yBx9vHIMIetjdvoFbwA Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:49:53.616912 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a243ba2c3f774c10b77a052075497b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a243ba2c3f774c10b77a052075497b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: a243ba2c3f774c10b77a052075497b92 Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1488690887 Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: c9a3a2e49fee4ea08ca790006d0b29e4 Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1488690887-project Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 could not be found. Jun 15 14:49:53.618433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66'} Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 could not be found. Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:53.619272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 could not be found. Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 could not be found. Jun 15 14:49:53.620827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.622158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] Returning 404 to user: Instance c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:53.622158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d4787730-72af-40b9-ac97-5fe7cd0ea8b6 tempest-ServerRescueNegativeTestJSON-1488690887 tempest-ServerRescueNegativeTestJSON-1488690887-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66" status: 404 len: 111 microversion: 2.1 time: 0.032549 Jun 15 14:49:53.622158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 336/681] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:53 2022] GET /compute/v2.1/servers/c0b5b9ac-e2de-428a-8dc5-efe3b99c2e66 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:49:53.631274 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:49:53.631706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:49:53.632158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:49:53.632568 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:49:53.632976 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:49:53.641776 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:53.642223 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:53.643076 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:53.643515 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:53.660822 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Getting quotas for project 6d3ce7cecd2f4983b8442f70ed2afdb1. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:49:53.664699 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Getting quotas for user 1efb0951ba1144d58698e02e0e5e9416 and project 6d3ce7cecd2f4983b8442f70ed2afdb1. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:49:53.676371 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:49:53.678632 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:49:53.726699 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-57c8f12b-c954-44c7-8015-39f6d4ce573d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613017 Jun 15 14:49:53.727374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 346/682] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:49:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:49:53.739797 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-06012d62-a511-4c82-a3ed-a9d9d5b7858b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:53.740413 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-06012d62-a511-4c82-a3ed-a9d9d5b7858b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:53.795144 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-06012d62-a511-4c82-a3ed-a9d9d5b7858b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:53.810059 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-06012d62-a511-4c82-a3ed-a9d9d5b7858b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1238 microversion: 2.1 time: 0.075774 Jun 15 14:49:53.810626 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 337/683] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:53 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:54.828468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2458d309-cb37-485a-94fa-18a45d5be51d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:54.829716 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2458d309-cb37-485a-94fa-18a45d5be51d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:54.837064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2458d309-cb37-485a-94fa-18a45d5be51d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:54.837518 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2458d309-cb37-485a-94fa-18a45d5be51d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:54.838306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2458d309-cb37-485a-94fa-18a45d5be51d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:54.838747 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2458d309-cb37-485a-94fa-18a45d5be51d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:54.919623 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2458d309-cb37-485a-94fa-18a45d5be51d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:54.929195 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2458d309-cb37-485a-94fa-18a45d5be51d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1298 microversion: 2.1 time: 0.104413 Jun 15 14:49:54.930192 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 347/684] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:54 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:55.947051 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bcf04a50-d655-47e5-ba0a-767db772f30e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:55.948375 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bcf04a50-d655-47e5-ba0a-767db772f30e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:55.956975 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcf04a50-d655-47e5-ba0a-767db772f30e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:55.957692 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcf04a50-d655-47e5-ba0a-767db772f30e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:55.958710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcf04a50-d655-47e5-ba0a-767db772f30e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:55.959348 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcf04a50-d655-47e5-ba0a-767db772f30e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:56.360847 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bcf04a50-d655-47e5-ba0a-767db772f30e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:56.375039 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bcf04a50-d655-47e5-ba0a-767db772f30e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1364 microversion: 2.1 time: 0.431857 Jun 15 14:49:56.376183 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 338/685] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:55 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1364 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:56.870270 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-b06b9746-47da-4086-9077-507b4dde4390 req-8952d5ac-04ba-46f1-8ace-d87677b11d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0d4bf9-714b-4617-a166-8a8930710d3d", "tag": "2af28279-f13c-4914-a2a0-7a1481f5364e"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:56.881415 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b06b9746-47da-4086-9077-507b4dde4390 req-8952d5ac-04ba-46f1-8ace-d87677b11d8c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:56.882472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b06b9746-47da-4086-9077-507b4dde4390 req-8952d5ac-04ba-46f1-8ace-d87677b11d8c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:56.903226 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-b06b9746-47da-4086-9077-507b4dde4390 req-8952d5ac-04ba-46f1-8ace-d87677b11d8c service nova] Creating event network-changed:2af28279-f13c-4914-a2a0-7a1481f5364e for instance ed0d4bf9-714b-4617-a166-8a8930710d3d on hv-cinder-80382 Jun 15 14:49:56.909513 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-b06b9746-47da-4086-9077-507b4dde4390 req-8952d5ac-04ba-46f1-8ace-d87677b11d8c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041535 Jun 15 14:49:56.909799 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 348/686] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:57.392084 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f0d75262-751b-4cca-83d9-af47ded49c23 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:57.393257 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f0d75262-751b-4cca-83d9-af47ded49c23 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:57.400070 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f0d75262-751b-4cca-83d9-af47ded49c23 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:57.400518 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f0d75262-751b-4cca-83d9-af47ded49c23 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:57.401282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f0d75262-751b-4cca-83d9-af47ded49c23 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:57.401715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f0d75262-751b-4cca-83d9-af47ded49c23 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:57.544253 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f0d75262-751b-4cca-83d9-af47ded49c23 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:57.552606 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f0d75262-751b-4cca-83d9-af47ded49c23 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1364 microversion: 2.1 time: 0.164409 Jun 15 14:49:57.562087 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 339/687] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:57 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:58.569726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-55a90125-5fc8-4603-8fe8-ad87558206d8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:58.570555 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-55a90125-5fc8-4603-8fe8-ad87558206d8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:58.576942 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-55a90125-5fc8-4603-8fe8-ad87558206d8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.577426 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-55a90125-5fc8-4603-8fe8-ad87558206d8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.578155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-55a90125-5fc8-4603-8fe8-ad87558206d8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.578590 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-55a90125-5fc8-4603-8fe8-ad87558206d8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.730020 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-55a90125-5fc8-4603-8fe8-ad87558206d8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:58.741843 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-55a90125-5fc8-4603-8fe8-ad87558206d8 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1364 microversion: 2.1 time: 0.176797 Jun 15 14:49:58.742597 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 349/688] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:58 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:59.759647 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9aef052a-9e98-42b6-8817-2812bf4d167e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:59.760248 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9aef052a-9e98-42b6-8817-2812bf4d167e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:59.767377 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9aef052a-9e98-42b6-8817-2812bf4d167e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.767817 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9aef052a-9e98-42b6-8817-2812bf4d167e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.768577 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9aef052a-9e98-42b6-8817-2812bf4d167e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.769066 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9aef052a-9e98-42b6-8817-2812bf4d167e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.907570 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9aef052a-9e98-42b6-8817-2812bf4d167e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:59.916180 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9aef052a-9e98-42b6-8817-2812bf4d167e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1364 microversion: 2.1 time: 0.160717 Jun 15 14:49:59.916790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 340/689] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:59 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:00.933272 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ca474e54-0a3c-48b1-80e9-97b8f1ae3d1b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:00.933919 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ca474e54-0a3c-48b1-80e9-97b8f1ae3d1b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:00.942478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ca474e54-0a3c-48b1-80e9-97b8f1ae3d1b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.942934 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ca474e54-0a3c-48b1-80e9-97b8f1ae3d1b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.943735 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ca474e54-0a3c-48b1-80e9-97b8f1ae3d1b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.944171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ca474e54-0a3c-48b1-80e9-97b8f1ae3d1b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:01.080513 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ca474e54-0a3c-48b1-80e9-97b8f1ae3d1b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:01.088044 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ca474e54-0a3c-48b1-80e9-97b8f1ae3d1b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1364 microversion: 2.1 time: 0.158572 Jun 15 14:50:01.088606 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 350/690] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:00 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:02.104677 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3d5b9896-cb8f-40db-9610-9a9d56b7d342 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:02.105288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3d5b9896-cb8f-40db-9610-9a9d56b7d342 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:02.112451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d5b9896-cb8f-40db-9610-9a9d56b7d342 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.112897 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d5b9896-cb8f-40db-9610-9a9d56b7d342 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.113664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d5b9896-cb8f-40db-9610-9a9d56b7d342 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.114118 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d5b9896-cb8f-40db-9610-9a9d56b7d342 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.243713 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3d5b9896-cb8f-40db-9610-9a9d56b7d342 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:02.251051 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3d5b9896-cb8f-40db-9610-9a9d56b7d342 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1364 microversion: 2.1 time: 0.150254 Jun 15 14:50:02.251970 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 341/691] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:02 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:03.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5757e733-713e-41b0-9022-b9e31794e09b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:03.268293 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5757e733-713e-41b0-9022-b9e31794e09b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:03.274855 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5757e733-713e-41b0-9022-b9e31794e09b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:03.275340 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5757e733-713e-41b0-9022-b9e31794e09b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:03.276106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5757e733-713e-41b0-9022-b9e31794e09b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:03.276539 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5757e733-713e-41b0-9022-b9e31794e09b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:03.408408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5757e733-713e-41b0-9022-b9e31794e09b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:03.416566 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5757e733-713e-41b0-9022-b9e31794e09b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1364 microversion: 2.1 time: 0.152713 Jun 15 14:50:03.417125 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 351/692] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:03 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:04.039665 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-2eba1120-47bb-4ae6-98fb-e9d376d7a53c req-33ca4d18-9ac4-4a99-9eff-06822ddb51ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0d4bf9-714b-4617-a166-8a8930710d3d", "name": "network-vif-plugged", "status": "completed", "tag": "2af28279-f13c-4914-a2a0-7a1481f5364e"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:04.043979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:04.053447 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-2eba1120-47bb-4ae6-98fb-e9d376d7a53c req-33ca4d18-9ac4-4a99-9eff-06822ddb51ea service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.053881 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-2eba1120-47bb-4ae6-98fb-e9d376d7a53c req-33ca4d18-9ac4-4a99-9eff-06822ddb51ea service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.065859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-2eba1120-47bb-4ae6-98fb-e9d376d7a53c req-33ca4d18-9ac4-4a99-9eff-06822ddb51ea service nova] Creating event network-vif-plugged:2af28279-f13c-4914-a2a0-7a1481f5364e for instance ed0d4bf9-714b-4617-a166-8a8930710d3d on hv-cinder-80382 Jun 15 14:50:04.070858 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-2eba1120-47bb-4ae6-98fb-e9d376d7a53c req-33ca4d18-9ac4-4a99-9eff-06822ddb51ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035089 Jun 15 14:50:04.071710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 342/693] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:04.434623 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-aba5eb6d-1b79-4570-99ca-5ab432590dd3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:04.435280 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-aba5eb6d-1b79-4570-99ca-5ab432590dd3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:04.437268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:04.437930 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:04.444996 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aba5eb6d-1b79-4570-99ca-5ab432590dd3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.445459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aba5eb6d-1b79-4570-99ca-5ab432590dd3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.446229 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aba5eb6d-1b79-4570-99ca-5ab432590dd3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.446666 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aba5eb6d-1b79-4570-99ca-5ab432590dd3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.578794 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-aba5eb6d-1b79-4570-99ca-5ab432590dd3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:04.586308 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-aba5eb6d-1b79-4570-99ca-5ab432590dd3 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1364 microversion: 2.1 time: 0.156939 Jun 15 14:50:04.586936 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 352/694] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:04 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:05.603891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-453c2541-4c3b-45fd-b26f-5b524f32ab28 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:05.604593 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-453c2541-4c3b-45fd-b26f-5b524f32ab28 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:05.611301 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-453c2541-4c3b-45fd-b26f-5b524f32ab28 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:05.611752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-453c2541-4c3b-45fd-b26f-5b524f32ab28 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:05.612529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-453c2541-4c3b-45fd-b26f-5b524f32ab28 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:05.612970 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-453c2541-4c3b-45fd-b26f-5b524f32ab28 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:05.755179 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-453c2541-4c3b-45fd-b26f-5b524f32ab28 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:05.762545 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-453c2541-4c3b-45fd-b26f-5b524f32ab28 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1364 microversion: 2.1 time: 0.162954 Jun 15 14:50:05.763164 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 343/695] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:05 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:06.779601 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2d2fda74-643f-400c-9691-cbf410039d5e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:06.780204 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2d2fda74-643f-400c-9691-cbf410039d5e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:06.787115 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2d2fda74-643f-400c-9691-cbf410039d5e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.787569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2d2fda74-643f-400c-9691-cbf410039d5e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.788327 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2d2fda74-643f-400c-9691-cbf410039d5e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.788761 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2d2fda74-643f-400c-9691-cbf410039d5e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.927403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2d2fda74-643f-400c-9691-cbf410039d5e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:06.934986 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2d2fda74-643f-400c-9691-cbf410039d5e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1551 microversion: 2.1 time: 0.159168 Jun 15 14:50:06.935582 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 353/696] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:06 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:06.953899 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0d4ca65c-5dd1-4091-b3ee-87b82ee9c71d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:06.955654 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0d4ca65c-5dd1-4091-b3ee-87b82ee9c71d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:06.962704 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d4ca65c-5dd1-4091-b3ee-87b82ee9c71d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.963203 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d4ca65c-5dd1-4091-b3ee-87b82ee9c71d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.963987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d4ca65c-5dd1-4091-b3ee-87b82ee9c71d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.964428 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d4ca65c-5dd1-4091-b3ee-87b82ee9c71d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:07.047108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0d4ca65c-5dd1-4091-b3ee-87b82ee9c71d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099504 Jun 15 14:50:07.047857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 344/697] 10.222.0.45 () {58 vars in 1274 bytes} [Wed Jun 15 14:50:06 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:08.003157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-b54afd78-6aef-47bb-ad17-d19a9518ff12 req-8430eb24-5bf9-4207-813f-bfc2acdbca7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0d4bf9-714b-4617-a166-8a8930710d3d", "tag": "2af28279-f13c-4914-a2a0-7a1481f5364e"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:08.012624 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b54afd78-6aef-47bb-ad17-d19a9518ff12 req-8430eb24-5bf9-4207-813f-bfc2acdbca7f service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:08.013257 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b54afd78-6aef-47bb-ad17-d19a9518ff12 req-8430eb24-5bf9-4207-813f-bfc2acdbca7f service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:08.025819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-b54afd78-6aef-47bb-ad17-d19a9518ff12 req-8430eb24-5bf9-4207-813f-bfc2acdbca7f service nova] Creating event network-changed:2af28279-f13c-4914-a2a0-7a1481f5364e for instance ed0d4bf9-714b-4617-a166-8a8930710d3d on hv-cinder-80382 Jun 15 14:50:08.030940 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-b54afd78-6aef-47bb-ad17-d19a9518ff12 req-8430eb24-5bf9-4207-813f-bfc2acdbca7f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031682 Jun 15 14:50:08.031714 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 354/698] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:31.601537 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:31.602292 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=50 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:31.606892 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1522362428", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "networks": [{"uuid": "1dcec554-3a4e-4f68-919e-92846629ada4"}]}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:31.658497 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] validate_networks() for [('1dcec554-3a4e-4f68-919e-92846629ada4', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:50:32.250901 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:50:32.251360 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:50:32.252412 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:50:32.252822 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:50:32.253236 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:50:32.262032 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.262480 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.263315 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.263752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.281232 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Getting quotas for project adc3fee639bd43c1b1b09f91b7d26ce3. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:50:32.285667 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Getting quotas for user 8757e4bdf31c4e96a50f8484d18872b5 and project adc3fee639bd43c1b1b09f91b7d26ce3. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:50:32.297053 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:50:32.300025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:50:32.346033 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c59bc222-7cf8-4224-ac8b-1e9ad925abf1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746175 Jun 15 14:50:32.346875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 345/699] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:50:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:50:32.354590 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:32.355362 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=86 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:32.359813 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a2da05a0-f3d3-45f3-b6b5-b392c4c6892c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:32.360527 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a2da05a0-f3d3-45f3-b6b5-b392c4c6892c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:32.416667 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a2da05a0-f3d3-45f3-b6b5-b392c4c6892c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:32.424759 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a2da05a0-f3d3-45f3-b6b5-b392c4c6892c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1214 microversion: 2.1 time: 0.071754 Jun 15 14:50:32.425617 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 355/700] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:32 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:33.442527 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-99c3764b-88e3-452a-b144-703a1ced9c53 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:33.443173 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-99c3764b-88e3-452a-b144-703a1ced9c53 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:33.450119 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99c3764b-88e3-452a-b144-703a1ced9c53 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.450754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99c3764b-88e3-452a-b144-703a1ced9c53 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.451583 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99c3764b-88e3-452a-b144-703a1ced9c53 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.452025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99c3764b-88e3-452a-b144-703a1ced9c53 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.521254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-99c3764b-88e3-452a-b144-703a1ced9c53 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:33.529097 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-99c3764b-88e3-452a-b144-703a1ced9c53 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1274 microversion: 2.1 time: 0.090955 Jun 15 14:50:33.529833 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 346/701] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:33 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:34.547602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-51b20a34-c827-4dc6-8156-db14dcbd00dd tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:34.548217 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-51b20a34-c827-4dc6-8156-db14dcbd00dd tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:34.554889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-51b20a34-c827-4dc6-8156-db14dcbd00dd tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.555383 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-51b20a34-c827-4dc6-8156-db14dcbd00dd tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.556161 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-51b20a34-c827-4dc6-8156-db14dcbd00dd tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.556597 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-51b20a34-c827-4dc6-8156-db14dcbd00dd tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.717263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-51b20a34-c827-4dc6-8156-db14dcbd00dd tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:34.726920 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-51b20a34-c827-4dc6-8156-db14dcbd00dd tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1314 microversion: 2.1 time: 0.182983 Jun 15 14:50:34.736648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 356/702] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:34 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:34.863755 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-13254161-c837-41a2-8d54-2dbada443885 req-9cc5408e-fc94-491a-9ae6-68f1ae7ef2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f790f803-4bf8-47a8-8bf2-090b7fa57138", "tag": "0e0376d2-207d-485d-a095-5b2b103147a0"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:34.874623 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-13254161-c837-41a2-8d54-2dbada443885 req-9cc5408e-fc94-491a-9ae6-68f1ae7ef2ac service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.875035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-13254161-c837-41a2-8d54-2dbada443885 req-9cc5408e-fc94-491a-9ae6-68f1ae7ef2ac service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.887834 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-13254161-c837-41a2-8d54-2dbada443885 req-9cc5408e-fc94-491a-9ae6-68f1ae7ef2ac service nova] Creating event network-changed:0e0376d2-207d-485d-a095-5b2b103147a0 for instance f790f803-4bf8-47a8-8bf2-090b7fa57138 on hv-cinder-80382 Jun 15 14:50:34.893919 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-13254161-c837-41a2-8d54-2dbada443885 req-9cc5408e-fc94-491a-9ae6-68f1ae7ef2ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035102 Jun 15 14:50:34.895053 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 347/703] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:35.744151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cd195169-0332-400c-8c61-b0dcf34fdb3e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:35.744768 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cd195169-0332-400c-8c61-b0dcf34fdb3e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:35.751284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd195169-0332-400c-8c61-b0dcf34fdb3e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.751791 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd195169-0332-400c-8c61-b0dcf34fdb3e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.752567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd195169-0332-400c-8c61-b0dcf34fdb3e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.753011 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd195169-0332-400c-8c61-b0dcf34fdb3e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.896566 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cd195169-0332-400c-8c61-b0dcf34fdb3e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:35.904764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cd195169-0332-400c-8c61-b0dcf34fdb3e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1314 microversion: 2.1 time: 0.164422 Jun 15 14:50:35.905340 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 357/704] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:35 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:36.924320 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bb55daa8-0a48-4211-913a-c4d60eea595e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:36.925013 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bb55daa8-0a48-4211-913a-c4d60eea595e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:36.931310 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb55daa8-0a48-4211-913a-c4d60eea595e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.931752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb55daa8-0a48-4211-913a-c4d60eea595e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.932510 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb55daa8-0a48-4211-913a-c4d60eea595e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.932937 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb55daa8-0a48-4211-913a-c4d60eea595e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.064022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bb55daa8-0a48-4211-913a-c4d60eea595e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:37.071491 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bb55daa8-0a48-4211-913a-c4d60eea595e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1314 microversion: 2.1 time: 0.152537 Jun 15 14:50:37.072056 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 348/705] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:36 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:38.088544 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-62da1d0e-efb5-4f49-a194-e714e5b14267 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:38.089186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-62da1d0e-efb5-4f49-a194-e714e5b14267 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:38.095421 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-62da1d0e-efb5-4f49-a194-e714e5b14267 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.095883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-62da1d0e-efb5-4f49-a194-e714e5b14267 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.096662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-62da1d0e-efb5-4f49-a194-e714e5b14267 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.097100 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-62da1d0e-efb5-4f49-a194-e714e5b14267 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.242315 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-62da1d0e-efb5-4f49-a194-e714e5b14267 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:38.254667 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-62da1d0e-efb5-4f49-a194-e714e5b14267 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1314 microversion: 2.1 time: 0.170173 Jun 15 14:50:38.255373 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 358/706] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:38 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:39.271851 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-89d1d3a7-c85a-43e8-a178-3b942dce0d05 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:39.272468 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-89d1d3a7-c85a-43e8-a178-3b942dce0d05 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:39.279091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89d1d3a7-c85a-43e8-a178-3b942dce0d05 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.279536 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89d1d3a7-c85a-43e8-a178-3b942dce0d05 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.280304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89d1d3a7-c85a-43e8-a178-3b942dce0d05 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.280766 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89d1d3a7-c85a-43e8-a178-3b942dce0d05 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.415263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-89d1d3a7-c85a-43e8-a178-3b942dce0d05 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:39.422706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-89d1d3a7-c85a-43e8-a178-3b942dce0d05 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1314 microversion: 2.1 time: 0.155443 Jun 15 14:50:39.423306 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 349/707] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:39 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:40.133458 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-26fe8cb6-6eae-4836-9052-32608515f7a5 req-2ceceea6-17c3-4c09-90a1-9cba1301620a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f790f803-4bf8-47a8-8bf2-090b7fa57138", "name": "network-vif-plugged", "status": "completed", "tag": "0e0376d2-207d-485d-a095-5b2b103147a0"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:40.142332 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-26fe8cb6-6eae-4836-9052-32608515f7a5 req-2ceceea6-17c3-4c09-90a1-9cba1301620a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.142961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-26fe8cb6-6eae-4836-9052-32608515f7a5 req-2ceceea6-17c3-4c09-90a1-9cba1301620a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.154325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-26fe8cb6-6eae-4836-9052-32608515f7a5 req-2ceceea6-17c3-4c09-90a1-9cba1301620a service nova] Creating event network-vif-plugged:0e0376d2-207d-485d-a095-5b2b103147a0 for instance f790f803-4bf8-47a8-8bf2-090b7fa57138 on hv-cinder-80382 Jun 15 14:50:40.159744 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-26fe8cb6-6eae-4836-9052-32608515f7a5 req-2ceceea6-17c3-4c09-90a1-9cba1301620a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029964 Jun 15 14:50:40.160329 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 359/708] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:40.440042 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7884c0c5-ef5a-479d-b36e-df2d8d41a96a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:40.440681 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7884c0c5-ef5a-479d-b36e-df2d8d41a96a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:40.447279 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7884c0c5-ef5a-479d-b36e-df2d8d41a96a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.447725 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7884c0c5-ef5a-479d-b36e-df2d8d41a96a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.448786 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7884c0c5-ef5a-479d-b36e-df2d8d41a96a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.449229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7884c0c5-ef5a-479d-b36e-df2d8d41a96a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.581213 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7884c0c5-ef5a-479d-b36e-df2d8d41a96a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:40.588621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7884c0c5-ef5a-479d-b36e-df2d8d41a96a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1314 microversion: 2.1 time: 0.152541 Jun 15 14:50:40.589635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 350/709] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:40 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:41.608158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-640548e2-e31f-41c3-becd-30ff768f6745 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:41.608848 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-640548e2-e31f-41c3-becd-30ff768f6745 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:41.615658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-640548e2-e31f-41c3-becd-30ff768f6745 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.616106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-640548e2-e31f-41c3-becd-30ff768f6745 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.616862 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-640548e2-e31f-41c3-becd-30ff768f6745 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.617289 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-640548e2-e31f-41c3-becd-30ff768f6745 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.751164 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-640548e2-e31f-41c3-becd-30ff768f6745 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:41.758905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-640548e2-e31f-41c3-becd-30ff768f6745 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1314 microversion: 2.1 time: 0.155632 Jun 15 14:50:41.759512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 360/710] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:41 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:42.776504 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a9ecb10b-5629-4d83-8c98-846c3258fc70 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:42.777118 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a9ecb10b-5629-4d83-8c98-846c3258fc70 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:42.779620 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:42.780587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:42.787333 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a9ecb10b-5629-4d83-8c98-846c3258fc70 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:42.787792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a9ecb10b-5629-4d83-8c98-846c3258fc70 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.788575 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a9ecb10b-5629-4d83-8c98-846c3258fc70 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:42.789051 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a9ecb10b-5629-4d83-8c98-846c3258fc70 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.927228 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a9ecb10b-5629-4d83-8c98-846c3258fc70 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:42.934785 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a9ecb10b-5629-4d83-8c98-846c3258fc70 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1497 microversion: 2.1 time: 0.162623 Jun 15 14:50:42.935377 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 351/711] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:42 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:43.440185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-24ce4844-d1f7-40e2-a1a1-00cc709ac61e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:43.440724 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-24ce4844-d1f7-40e2-a1a1-00cc709ac61e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:43.442715 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:43.448663 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-24ce4844-d1f7-40e2-a1a1-00cc709ac61e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.449102 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-24ce4844-d1f7-40e2-a1a1-00cc709ac61e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.449855 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-24ce4844-d1f7-40e2-a1a1-00cc709ac61e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.450284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-24ce4844-d1f7-40e2-a1a1-00cc709ac61e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.476291 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-24ce4844-d1f7-40e2-a1a1-00cc709ac61e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:50:43.550222 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-24ce4844-d1f7-40e2-a1a1-00cc709ac61e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 204 len: 0 microversion: 2.1 time: 0.113971 Jun 15 14:50:43.551023 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 361/712] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:50:43 2022] DELETE /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:50:43.559380 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0fb70c0d-23d7-4b91-9cd2-c273f41b7ad1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:43.560105 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0fb70c0d-23d7-4b91-9cd2-c273f41b7ad1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:43.586885 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0fb70c0d-23d7-4b91-9cd2-c273f41b7ad1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.587409 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0fb70c0d-23d7-4b91-9cd2-c273f41b7ad1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.588194 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0fb70c0d-23d7-4b91-9cd2-c273f41b7ad1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.588672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0fb70c0d-23d7-4b91-9cd2-c273f41b7ad1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.717416 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0fb70c0d-23d7-4b91-9cd2-c273f41b7ad1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:43.725045 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0fb70c0d-23d7-4b91-9cd2-c273f41b7ad1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1503 microversion: 2.1 time: 0.169636 Jun 15 14:50:43.725615 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 352/713] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:43 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:44.743286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f8b24605-76f0-4a5b-8536-ac24d5ccea5f tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:44.743994 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f8b24605-76f0-4a5b-8536-ac24d5ccea5f tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:44.750504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8b24605-76f0-4a5b-8536-ac24d5ccea5f tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.751032 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8b24605-76f0-4a5b-8536-ac24d5ccea5f tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.752502 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8b24605-76f0-4a5b-8536-ac24d5ccea5f tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.752938 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8b24605-76f0-4a5b-8536-ac24d5ccea5f tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.891697 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f8b24605-76f0-4a5b-8536-ac24d5ccea5f tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:44.900019 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f8b24605-76f0-4a5b-8536-ac24d5ccea5f tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1503 microversion: 2.1 time: 0.161044 Jun 15 14:50:44.900595 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 362/714] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:44 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:45.916792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1dd48567-b8ac-4652-942c-3f59d3a5c99a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:45.917569 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1dd48567-b8ac-4652-942c-3f59d3a5c99a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:45.924227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1dd48567-b8ac-4652-942c-3f59d3a5c99a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.924672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1dd48567-b8ac-4652-942c-3f59d3a5c99a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.925439 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1dd48567-b8ac-4652-942c-3f59d3a5c99a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.925868 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1dd48567-b8ac-4652-942c-3f59d3a5c99a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.991836 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1dd48567-b8ac-4652-942c-3f59d3a5c99a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:45.999834 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1dd48567-b8ac-4652-942c-3f59d3a5c99a tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 200 len: 1461 microversion: 2.1 time: 0.086980 Jun 15 14:50:46.000425 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 353/715] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:45 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 1461 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:46.062028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-b909978f-5eae-4124-bfd9-2e5acd0a04f2 req-ffb0e898-d208-44b2-8a0e-b5c25aff6c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f790f803-4bf8-47a8-8bf2-090b7fa57138", "name": "network-vif-deleted", "tag": "0e0376d2-207d-485d-a095-5b2b103147a0"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:46.071272 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b909978f-5eae-4124-bfd9-2e5acd0a04f2 req-ffb0e898-d208-44b2-8a0e-b5c25aff6c49 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.071674 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-b909978f-5eae-4124-bfd9-2e5acd0a04f2 req-ffb0e898-d208-44b2-8a0e-b5c25aff6c49 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.083657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-b909978f-5eae-4124-bfd9-2e5acd0a04f2 req-ffb0e898-d208-44b2-8a0e-b5c25aff6c49 service nova] Creating event network-vif-deleted:0e0376d2-207d-485d-a095-5b2b103147a0 for instance f790f803-4bf8-47a8-8bf2-090b7fa57138 on hv-cinder-80382 Jun 15 14:50:46.090298 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-b909978f-5eae-4124-bfd9-2e5acd0a04f2 req-ffb0e898-d208-44b2-8a0e-b5c25aff6c49 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031622 Jun 15 14:50:46.091074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 363/716] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:47.018196 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:47.018813 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: f790f803-4bf8-47a8-8bf2-090b7fa57138] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:47.025408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.025864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.026634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.027095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.040973 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] HTTP exception thrown: Instance f790f803-4bf8-47a8-8bf2-090b7fa57138 could not be found. Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Request method failure captured: Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 HTTP/1.1 Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfG2M5SKvqLTrLxZ4aks1zLdToZrkXn8YT0sNCrbrfThULjJ3QBWcofOwTfiPQAig_zeUYQUaHsF0G40kzTm80rTseTJk3znwPcMyvTaCYF2C6wBK1J8Vme79u1sjT42YhyuQJ5-vhCz6thSbytUZHmCpD_EpZLkSv1TjS2nvi8izcE Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: adc3fee639bd43c1b1b09f91b7d26ce3 Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesActionsTest-177409106 Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:50:47.042600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/adc3fee639bd43c1b1b09f91b7d26ce3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_adc3fee639bd43c1b1b09f91b7d26ce3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/adc3fee639bd43c1b1b09f91b7d26ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/adc3fee639bd43c1b1b09f91b7d26ce3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesActionsTest-177409106 Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: adc3fee639bd43c1b1b09f91b7d26ce3 Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesActionsTest-177409106 Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesActionsTest-177409106-project Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 8757e4bdf31c4e96a50f8484d18872b5 Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesActionsTest-177409106-project Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance f790f803-4bf8-47a8-8bf2-090b7fa57138 could not be found. Jun 15 14:50:47.044221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'f790f803-4bf8-47a8-8bf2-090b7fa57138'} Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f790f803-4bf8-47a8-8bf2-090b7fa57138 could not be found. Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:50:47.045167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f790f803-4bf8-47a8-8bf2-090b7fa57138 could not be found. Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f790f803-4bf8-47a8-8bf2-090b7fa57138 could not be found. Jun 15 14:50:47.046650 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:50:47.048018 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Returning 404 to user: Instance f790f803-4bf8-47a8-8bf2-090b7fa57138 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:50:47.048018 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e3383fa3-a422-40ab-b390-31c03cf6a481 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138" status: 404 len: 111 microversion: 2.1 time: 0.029825 Jun 15 14:50:47.048018 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 354/717] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:47 2022] GET /compute/v2.1/servers/f790f803-4bf8-47a8-8bf2-090b7fa57138 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:50:47.092463 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-716089599", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "networks": [{"uuid": "1dcec554-3a4e-4f68-919e-92846629ada4"}]}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:47.142516 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] validate_networks() for [('1dcec554-3a4e-4f68-919e-92846629ada4', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:50:47.492970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:50:47.493389 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:50:47.493874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:50:47.494290 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:50:47.494694 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:50:47.503560 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.504052 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.504870 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.505353 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.522733 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Getting quotas for project adc3fee639bd43c1b1b09f91b7d26ce3. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:50:47.526717 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Getting quotas for user 8757e4bdf31c4e96a50f8484d18872b5 and project adc3fee639bd43c1b1b09f91b7d26ce3. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:50:47.539578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:50:47.541930 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:50:47.586724 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7e2b3a17-2eac-447a-bf95-0480bb65d270 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498828 Jun 15 14:50:47.587393 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 364/718] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:50:47.597604 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fcab2389-df7f-48ed-8979-764b974a6809 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:47.598223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fcab2389-df7f-48ed-8979-764b974a6809 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:47.650302 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fcab2389-df7f-48ed-8979-764b974a6809 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:47.657141 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fcab2389-df7f-48ed-8979-764b974a6809 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1213 microversion: 2.1 time: 0.063411 Jun 15 14:50:47.657713 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 355/719] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:47 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:48.674958 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-749c3b6f-39ca-4b3b-9a47-c2f7ec3a5a37 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:48.675589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-749c3b6f-39ca-4b3b-9a47-c2f7ec3a5a37 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:48.682358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-749c3b6f-39ca-4b3b-9a47-c2f7ec3a5a37 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.682800 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-749c3b6f-39ca-4b3b-9a47-c2f7ec3a5a37 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.683585 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-749c3b6f-39ca-4b3b-9a47-c2f7ec3a5a37 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.684018 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-749c3b6f-39ca-4b3b-9a47-c2f7ec3a5a37 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.748662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-749c3b6f-39ca-4b3b-9a47-c2f7ec3a5a37 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:48.756239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-749c3b6f-39ca-4b3b-9a47-c2f7ec3a5a37 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1265 microversion: 2.1 time: 0.086338 Jun 15 14:50:48.756801 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 365/720] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:48 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:49.772719 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d4de6fc3-52bf-4e9e-9509-1b6d3efac7b1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:49.774025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d4de6fc3-52bf-4e9e-9509-1b6d3efac7b1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:49.781454 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4de6fc3-52bf-4e9e-9509-1b6d3efac7b1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.781911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4de6fc3-52bf-4e9e-9509-1b6d3efac7b1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.783375 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4de6fc3-52bf-4e9e-9509-1b6d3efac7b1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.784273 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d4de6fc3-52bf-4e9e-9509-1b6d3efac7b1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.994439 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d4de6fc3-52bf-4e9e-9509-1b6d3efac7b1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:50.002913 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d4de6fc3-52bf-4e9e-9509-1b6d3efac7b1 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1313 microversion: 2.1 time: 0.234014 Jun 15 14:50:50.003940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 356/721] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:49 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:50.178618 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-fecb946c-1bc9-474f-af81-12df28311f6a req-c5758039-e4bc-4c02-809d-a34a861abced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d599b0-3d62-4f32-8fdc-37d92d9b9a72", "tag": "14d2dd76-fcfb-4108-8f67-2eea9c2ba1d9"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:50.187869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-fecb946c-1bc9-474f-af81-12df28311f6a req-c5758039-e4bc-4c02-809d-a34a861abced service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.187869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-fecb946c-1bc9-474f-af81-12df28311f6a req-c5758039-e4bc-4c02-809d-a34a861abced service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.200241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-fecb946c-1bc9-474f-af81-12df28311f6a req-c5758039-e4bc-4c02-809d-a34a861abced service nova] Creating event network-changed:14d2dd76-fcfb-4108-8f67-2eea9c2ba1d9 for instance 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 on hv-cinder-80382 Jun 15 14:50:50.205467 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-fecb946c-1bc9-474f-af81-12df28311f6a req-c5758039-e4bc-4c02-809d-a34a861abced service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030125 Jun 15 14:50:50.206078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 366/722] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:51.020397 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1ccfbd97-4cc3-4ed4-b220-70e27ce0f9a8 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:51.020940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1ccfbd97-4cc3-4ed4-b220-70e27ce0f9a8 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:51.027580 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ccfbd97-4cc3-4ed4-b220-70e27ce0f9a8 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.028025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ccfbd97-4cc3-4ed4-b220-70e27ce0f9a8 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.028788 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ccfbd97-4cc3-4ed4-b220-70e27ce0f9a8 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.029220 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ccfbd97-4cc3-4ed4-b220-70e27ce0f9a8 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.164560 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1ccfbd97-4cc3-4ed4-b220-70e27ce0f9a8 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:51.175705 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1ccfbd97-4cc3-4ed4-b220-70e27ce0f9a8 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1313 microversion: 2.1 time: 0.158980 Jun 15 14:50:51.176634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 357/723] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:51 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:52.194517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e74f6141-31e2-4335-8aff-ed3449c8a445 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:52.195237 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e74f6141-31e2-4335-8aff-ed3449c8a445 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:52.201450 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e74f6141-31e2-4335-8aff-ed3449c8a445 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.201899 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e74f6141-31e2-4335-8aff-ed3449c8a445 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.202658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e74f6141-31e2-4335-8aff-ed3449c8a445 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.203119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e74f6141-31e2-4335-8aff-ed3449c8a445 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.330522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e74f6141-31e2-4335-8aff-ed3449c8a445 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:52.337896 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e74f6141-31e2-4335-8aff-ed3449c8a445 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1313 microversion: 2.1 time: 0.148630 Jun 15 14:50:52.338459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 367/724] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:52 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:53.354855 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e51051bf-255a-4fae-ad20-90edbd05252c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:53.355490 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e51051bf-255a-4fae-ad20-90edbd05252c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:53.362087 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e51051bf-255a-4fae-ad20-90edbd05252c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.362534 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e51051bf-255a-4fae-ad20-90edbd05252c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.363501 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e51051bf-255a-4fae-ad20-90edbd05252c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.363778 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e51051bf-255a-4fae-ad20-90edbd05252c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.503940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e51051bf-255a-4fae-ad20-90edbd05252c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:53.511334 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e51051bf-255a-4fae-ad20-90edbd05252c tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1313 microversion: 2.1 time: 0.160359 Jun 15 14:50:53.511894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 358/725] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:53 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:54.528777 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-dd09b6ae-25bf-4db8-9ead-d63aaa80cc66 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:54.529378 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-dd09b6ae-25bf-4db8-9ead-d63aaa80cc66 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:54.538014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd09b6ae-25bf-4db8-9ead-d63aaa80cc66 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.538455 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd09b6ae-25bf-4db8-9ead-d63aaa80cc66 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.539468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd09b6ae-25bf-4db8-9ead-d63aaa80cc66 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.539977 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd09b6ae-25bf-4db8-9ead-d63aaa80cc66 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.672233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-dd09b6ae-25bf-4db8-9ead-d63aaa80cc66 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:54.681562 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-dd09b6ae-25bf-4db8-9ead-d63aaa80cc66 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1313 microversion: 2.1 time: 0.156711 Jun 15 14:50:54.682129 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 368/726] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:54 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:55.697934 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-53e1a8ab-dcd8-4b88-a7b2-0a66968dbd45 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:55.698538 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-53e1a8ab-dcd8-4b88-a7b2-0a66968dbd45 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:55.705192 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-53e1a8ab-dcd8-4b88-a7b2-0a66968dbd45 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.705642 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-53e1a8ab-dcd8-4b88-a7b2-0a66968dbd45 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.706445 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-53e1a8ab-dcd8-4b88-a7b2-0a66968dbd45 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.706885 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-53e1a8ab-dcd8-4b88-a7b2-0a66968dbd45 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.835056 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-53e1a8ab-dcd8-4b88-a7b2-0a66968dbd45 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:55.842385 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-53e1a8ab-dcd8-4b88-a7b2-0a66968dbd45 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1313 microversion: 2.1 time: 0.148279 Jun 15 14:50:55.842942 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 359/727] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:55 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:56.206573 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-0892a88b-cb4d-463d-87af-068486b07542 req-65436129-03bb-4199-8ce4-3dca683efe4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d599b0-3d62-4f32-8fdc-37d92d9b9a72", "name": "network-vif-plugged", "status": "completed", "tag": "14d2dd76-fcfb-4108-8f67-2eea9c2ba1d9"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:56.217532 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-0892a88b-cb4d-463d-87af-068486b07542 req-65436129-03bb-4199-8ce4-3dca683efe4a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.218115 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-0892a88b-cb4d-463d-87af-068486b07542 req-65436129-03bb-4199-8ce4-3dca683efe4a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.230591 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-0892a88b-cb4d-463d-87af-068486b07542 req-65436129-03bb-4199-8ce4-3dca683efe4a service nova] Creating event network-vif-plugged:14d2dd76-fcfb-4108-8f67-2eea9c2ba1d9 for instance 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 on hv-cinder-80382 Jun 15 14:50:56.235664 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-0892a88b-cb4d-463d-87af-068486b07542 req-65436129-03bb-4199-8ce4-3dca683efe4a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033285 Jun 15 14:50:56.236565 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 369/728] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:56.859147 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-52f964da-3b55-4eba-a326-eb96998a5f1e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:56.859750 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-52f964da-3b55-4eba-a326-eb96998a5f1e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:56.865732 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52f964da-3b55-4eba-a326-eb96998a5f1e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.866171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52f964da-3b55-4eba-a326-eb96998a5f1e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.866922 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52f964da-3b55-4eba-a326-eb96998a5f1e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.867377 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52f964da-3b55-4eba-a326-eb96998a5f1e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.998092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-52f964da-3b55-4eba-a326-eb96998a5f1e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:57.006231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-52f964da-3b55-4eba-a326-eb96998a5f1e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1313 microversion: 2.1 time: 0.151132 Jun 15 14:50:57.006790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 360/729] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:56 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:58.024202 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-09d2e816-1266-4b34-be80-1ec826d519fc tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:58.024818 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-09d2e816-1266-4b34-be80-1ec826d519fc tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:58.027230 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:58.028008 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:58.034746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-09d2e816-1266-4b34-be80-1ec826d519fc tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.035225 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-09d2e816-1266-4b34-be80-1ec826d519fc tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:58.035990 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-09d2e816-1266-4b34-be80-1ec826d519fc tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.036423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-09d2e816-1266-4b34-be80-1ec826d519fc tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:58.173383 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-09d2e816-1266-4b34-be80-1ec826d519fc tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:58.180779 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-09d2e816-1266-4b34-be80-1ec826d519fc tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1313 microversion: 2.1 time: 0.160835 Jun 15 14:50:58.181347 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 370/730] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:58 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:59.198339 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3d88e3ca-6937-4b44-a916-c2ababcb6864 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:59.198977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3d88e3ca-6937-4b44-a916-c2ababcb6864 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:59.200952 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:59.208045 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d88e3ca-6937-4b44-a916-c2ababcb6864 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:59.208523 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d88e3ca-6937-4b44-a916-c2ababcb6864 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:59.209303 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d88e3ca-6937-4b44-a916-c2ababcb6864 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:59.210376 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d88e3ca-6937-4b44-a916-c2ababcb6864 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:59.360120 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3d88e3ca-6937-4b44-a916-c2ababcb6864 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:59.371009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3d88e3ca-6937-4b44-a916-c2ababcb6864 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1497 microversion: 2.1 time: 0.176440 Jun 15 14:50:59.371623 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 361/731] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:59 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:00.008330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fe517a3e-a24a-4835-be9a-a91ca413cf1b tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:00.008855 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fe517a3e-a24a-4835-be9a-a91ca413cf1b tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:00.015576 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fe517a3e-a24a-4835-be9a-a91ca413cf1b tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.016035 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fe517a3e-a24a-4835-be9a-a91ca413cf1b tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.016804 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fe517a3e-a24a-4835-be9a-a91ca413cf1b tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.017778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fe517a3e-a24a-4835-be9a-a91ca413cf1b tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.044023 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fe517a3e-a24a-4835-be9a-a91ca413cf1b tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:51:00.117623 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fe517a3e-a24a-4835-be9a-a91ca413cf1b tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "DELETE /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 204 len: 0 microversion: 2.1 time: 0.112817 Jun 15 14:51:00.118204 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 371/732] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:51:00 2022] DELETE /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:51:00.126947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2d897c3d-32d8-470c-8405-1fd0b973a65e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:00.127534 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2d897c3d-32d8-470c-8405-1fd0b973a65e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:00.133572 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d897c3d-32d8-470c-8405-1fd0b973a65e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.134027 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d897c3d-32d8-470c-8405-1fd0b973a65e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.134790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d897c3d-32d8-470c-8405-1fd0b973a65e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.135258 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d897c3d-32d8-470c-8405-1fd0b973a65e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.263282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2d897c3d-32d8-470c-8405-1fd0b973a65e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:00.271635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2d897c3d-32d8-470c-8405-1fd0b973a65e tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1503 microversion: 2.1 time: 0.148647 Jun 15 14:51:00.272289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 362/733] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:00 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:01.294928 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-00624264-9b10-44ca-b094-d6bf155da5be tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:01.295655 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-00624264-9b10-44ca-b094-d6bf155da5be tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:01.302960 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-00624264-9b10-44ca-b094-d6bf155da5be tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:01.303447 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-00624264-9b10-44ca-b094-d6bf155da5be tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:01.304214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-00624264-9b10-44ca-b094-d6bf155da5be tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:01.304651 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-00624264-9b10-44ca-b094-d6bf155da5be tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:01.322600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:01.436913 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-00624264-9b10-44ca-b094-d6bf155da5be tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:01.444488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-00624264-9b10-44ca-b094-d6bf155da5be tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1503 microversion: 2.1 time: 0.153797 Jun 15 14:51:01.445059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 372/734] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:01 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:02.461529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-64213d67-e015-4331-a623-233afff842e6 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:02.462077 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-64213d67-e015-4331-a623-233afff842e6 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:02.464320 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:02.469989 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64213d67-e015-4331-a623-233afff842e6 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:02.470447 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64213d67-e015-4331-a623-233afff842e6 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:02.471234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64213d67-e015-4331-a623-233afff842e6 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:02.471661 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64213d67-e015-4331-a623-233afff842e6 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:02.474694 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=91 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:02.606325 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-64213d67-e015-4331-a623-233afff842e6 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:02.614512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-64213d67-e015-4331-a623-233afff842e6 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1503 microversion: 2.1 time: 0.156901 Jun 15 14:51:02.615306 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 363/735] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:02 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:03.195214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-ce2b187f-609e-4fdd-9e5c-ff6d66cd4582 req-23ab166c-26cb-4e45-aa21-c234f30e1fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d599b0-3d62-4f32-8fdc-37d92d9b9a72", "name": "network-vif-deleted", "tag": "14d2dd76-fcfb-4108-8f67-2eea9c2ba1d9"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:03.199344 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:03.207042 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-ce2b187f-609e-4fdd-9e5c-ff6d66cd4582 req-23ab166c-26cb-4e45-aa21-c234f30e1fa4 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.207491 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-ce2b187f-609e-4fdd-9e5c-ff6d66cd4582 req-23ab166c-26cb-4e45-aa21-c234f30e1fa4 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.221222 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-ce2b187f-609e-4fdd-9e5c-ff6d66cd4582 req-23ab166c-26cb-4e45-aa21-c234f30e1fa4 service nova] Creating event network-vif-deleted:14d2dd76-fcfb-4108-8f67-2eea9c2ba1d9 for instance 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 on hv-cinder-80382 Jun 15 14:51:03.226918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-ce2b187f-609e-4fdd-9e5c-ff6d66cd4582 req-23ab166c-26cb-4e45-aa21-c234f30e1fa4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035367 Jun 15 14:51:03.227569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 373/736] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:51:03.631903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:03.632883 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:03.639368 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.639818 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.640584 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.641020 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.672019 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.672462 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.672907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lazy-loading 'fault' on Instance uuid 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:51:03.713800 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8757e4bdf31c4e96a50f8484d18872b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc3fee639bd43c1b1b09f91b7d26ce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:03.721588 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b50e1868-d052-4e00-9068-c1e281751c90 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 200 len: 1303 microversion: 2.1 time: 0.093479 Jun 15 14:51:03.722159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 364/737] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:03 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:04.739734 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:04.740431 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] [instance: 90d599b0-3d62-4f32-8fdc-37d92d9b9a72] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:04.746590 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:04.747074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:04.747830 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:04.748261 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:04.761228 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] HTTP exception thrown: Instance 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 could not be found. Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Request method failure captured: Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 HTTP/1.1 Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfG2M5SKvqLTrLxZ4aks1zLdToZrkXn8YT0sNCrbrfThULjJ3QBWcofOwTfiPQAig_zeUYQUaHsF0G40kzTm80rTseTJk3znwPcMyvTaCYF2C6wBK1J8Vme79u1sjT42YhyuQJ5-vhCz6thSbytUZHmCpD_EpZLkSv1TjS2nvi8izcE Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: adc3fee639bd43c1b1b09f91b7d26ce3 Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-VolumesActionsTest-177409106 Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:51:04.762810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/adc3fee639bd43c1b1b09f91b7d26ce3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_adc3fee639bd43c1b1b09f91b7d26ce3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/adc3fee639bd43c1b1b09f91b7d26ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/adc3fee639bd43c1b1b09f91b7d26ce3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-VolumesActionsTest-177409106 Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: adc3fee639bd43c1b1b09f91b7d26ce3 Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-VolumesActionsTest-177409106 Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-VolumesActionsTest-177409106-project Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 8757e4bdf31c4e96a50f8484d18872b5 Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-VolumesActionsTest-177409106-project Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 could not be found. Jun 15 14:51:04.764457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '90d599b0-3d62-4f32-8fdc-37d92d9b9a72'} Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 could not be found. Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:04.765278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 could not be found. Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 could not be found. Jun 15 14:51:04.766451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:51:04.768099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] Returning 404 to user: Instance 90d599b0-3d62-4f32-8fdc-37d92d9b9a72 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:04.768099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f7d37204-850b-4e86-9053-434c7af40379 tempest-VolumesActionsTest-177409106 tempest-VolumesActionsTest-177409106-project] 10.222.0.45 "GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72" status: 404 len: 111 microversion: 2.1 time: 0.029259 Jun 15 14:51:04.768099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 374/738] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:04 2022] GET /compute/v2.1/servers/90d599b0-3d62-4f32-8fdc-37d92d9b9a72 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:08.941520 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bc6676ba-808f-42c3-b7a6-0f6b7a5dc0a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:08.942113 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bc6676ba-808f-42c3-b7a6-0f6b7a5dc0a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:08.948496 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc6676ba-808f-42c3-b7a6-0f6b7a5dc0a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.948942 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc6676ba-808f-42c3-b7a6-0f6b7a5dc0a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:08.949705 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc6676ba-808f-42c3-b7a6-0f6b7a5dc0a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.950147 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc6676ba-808f-42c3-b7a6-0f6b7a5dc0a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:08.972441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bc6676ba-808f-42c3-b7a6-0f6b7a5dc0a4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/ips" status: 200 len: 152 microversion: 2.20 time: 0.035591 Jun 15 14:51:08.973126 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 365/739] 10.222.0.45 () {60 vars in 1288 bytes} [Wed Jun 15 14:51:08 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:51:12.663425 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-246c35b6-ec45-4ae7-8834-f6d79c7d0085 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:12.664707 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-246c35b6-ec45-4ae7-8834-f6d79c7d0085 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:12.671330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-246c35b6-ec45-4ae7-8834-f6d79c7d0085 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:12.671780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-246c35b6-ec45-4ae7-8834-f6d79c7d0085 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:12.672549 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-246c35b6-ec45-4ae7-8834-f6d79c7d0085 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:12.673744 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-246c35b6-ec45-4ae7-8834-f6d79c7d0085 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:12.698007 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-246c35b6-ec45-4ae7-8834-f6d79c7d0085 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lazy-loading 'flavor' on Instance uuid c00a072c-e13e-4b90-b5f4-7341aea301b7 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:51:13.023379 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-246c35b6-ec45-4ae7-8834-f6d79c7d0085 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/action" status: 202 len: 0 microversion: 2.20 time: 0.363924 Jun 15 14:51:13.024029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 375/740] 10.222.0.45 () {62 vars in 1318 bytes} [Wed Jun 15 14:51:12 2022] POST /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:51:13.033634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:13.034240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:13.045209 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:13.046003 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:13.046905 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:13.047372 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:13.208365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:13.218502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:13.220143 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:13.221348 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-020a84b9-d1b0-4593-8b6a-9ec56c6083e2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.192771 Jun 15 14:51:13.222071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 366/741] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:13 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:14.243223 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:14.244596 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:14.251238 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:14.252123 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:14.253021 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:14.253487 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:14.419268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:14.431297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:14.432995 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:14.434218 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8af5ad7c-e621-43c3-9f33-66dfd01124aa tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.195798 Jun 15 14:51:14.434774 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 376/742] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:14 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:15.456347 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:15.456985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:15.464338 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.465115 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.465940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.466422 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.652171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:15.665113 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:15.667417 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:15.669185 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-07589509-7825-4d87-bb69-b36ada49083e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.216902 Jun 15 14:51:15.670119 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 367/743] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:15 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:16.690287 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:16.691392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:16.700644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.701103 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.702284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.702830 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.875294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:16.894962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:16.897238 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:16.898900 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3cb155ac-3002-4fa8-a73e-6eaeca6c3fc0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.213897 Jun 15 14:51:16.899682 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 377/744] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:16 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:17.920964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:17.922585 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:17.933542 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:17.934011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:17.935034 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:17.935986 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:18.103838 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:18.117174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:18.119743 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:18.121219 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cff1d77b-1f4e-49ef-b9be-51e5892ba221 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.206475 Jun 15 14:51:18.122249 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 368/745] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:17 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:19.140736 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:19.141507 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:19.148503 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:19.149060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:19.149929 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:19.150456 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:19.302465 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:19.311643 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:19.313464 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:19.314392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1b6a6daa-7d65-4d52-84d6-f8191a1ce100 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.177790 Jun 15 14:51:19.315332 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 378/746] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:19 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:20.334418 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:20.335238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:20.343304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:20.343829 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:20.344619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:20.345087 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:20.515774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:20.524982 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:20.526473 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:20.527971 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ab8df455-37dc-4033-adbf-670d9f38161d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.199323 Jun 15 14:51:20.528489 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 369/747] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:20 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:21.545932 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:21.547187 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:21.554144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:21.554877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:21.555995 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:21.556439 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:21.701062 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:21.712491 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:21.714114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:21.715684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6e109bdd-3de9-4b1a-a9ad-200e52893161 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.173887 Jun 15 14:51:21.727177 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 379/748] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:21 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:22.734026 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:22.734633 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:22.742337 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:22.742803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:22.743639 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:22.744295 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:22.890233 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:22.899384 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:22.900905 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:22.902282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7ac45642-f49c-4b33-aaad-570d8784b4ac tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.172214 Jun 15 14:51:22.903412 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 370/749] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:22 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:23.921925 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:23.923283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:23.930153 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:23.930788 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:23.931627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:23.932066 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:24.084757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:24.093356 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:24.095143 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:24.096319 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f4e63ce9-aaf3-4627-9fa3-f096f6a0bbc8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.178622 Jun 15 14:51:24.097058 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 380/750] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:23 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:25.114090 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:25.115450 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:25.125076 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:25.126344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:25.127223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:25.127635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:25.286526 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:25.296478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:25.298144 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:25.299618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1ece962b-d538-466d-83f4-2faac7f53c4b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.189556 Jun 15 14:51:25.300198 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 371/751] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:25 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:26.317898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:26.318503 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:26.325018 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:26.325460 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:26.326219 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:26.326647 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:26.460370 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:26.468214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:26.469765 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:26.471490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-473c0d71-cb77-46b8-8d5d-fc407000b063 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.157498 Jun 15 14:51:26.472040 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 381/752] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:26 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:27.490572 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:27.491215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:27.497483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:27.497876 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:27.498686 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:27.499160 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:27.633007 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:27.640942 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:27.642456 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:27.643630 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bebb0f8e-cc96-4c10-82c9-a31e22f74640 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.157155 Jun 15 14:51:27.644192 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 372/753] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:27 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:28.661752 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:28.662624 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:28.669119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:28.669583 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:28.670359 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:28.670802 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:28.855204 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:28.864654 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:28.866224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:28.867438 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9168ff85-02e7-4719-a45a-c0e41724c295 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.209624 Jun 15 14:51:28.867997 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 382/754] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:28 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:29.885815 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:29.886459 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:29.893960 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:29.894560 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:29.895536 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:29.896092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:30.040915 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:30.050713 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:30.052387 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:30.053739 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ec02916d-5c91-49e0-a7ff-2e5eb27ceb19 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1743 microversion: 2.20 time: 0.172080 Jun 15 14:51:30.054293 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 373/755] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:29 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:31.072762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:31.073404 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:31.079952 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:31.080405 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:31.081166 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:31.081605 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:31.216498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:31.226100 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:31.228705 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:31.230368 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-89c15046-efea-47f6-9b1a-29aeb6c678ef tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1743 microversion: 2.20 time: 0.161387 Jun 15 14:51:31.231092 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 383/756] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:31 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:32.248733 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:32.249443 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:32.257163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:32.257619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:32.258436 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:32.258868 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:32.399340 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:32.408153 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:32.409683 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:32.410926 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8326a357-90d0-4f28-9242-806004e274ce tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1743 microversion: 2.20 time: 0.166188 Jun 15 14:51:32.411542 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 374/757] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:32 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:32.441781 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-c1ddfc70-34a7-44bc-a67f-cfa2f4fc7c98 req-c7a212f1-b4a4-467a-a362-5592f59b3cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00a072c-e13e-4b90-b5f4-7341aea301b7", "name": "network-vif-plugged", "status": "completed", "tag": "5b328c6b-5677-47c6-b09a-974f22b96d56"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:32.451364 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c1ddfc70-34a7-44bc-a67f-cfa2f4fc7c98 req-c7a212f1-b4a4-467a-a362-5592f59b3cd3 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:32.451984 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c1ddfc70-34a7-44bc-a67f-cfa2f4fc7c98 req-c7a212f1-b4a4-467a-a362-5592f59b3cd3 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:32.455726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:32.465332 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-c1ddfc70-34a7-44bc-a67f-cfa2f4fc7c98 req-c7a212f1-b4a4-467a-a362-5592f59b3cd3 service nova] Creating event network-vif-plugged:5b328c6b-5677-47c6-b09a-974f22b96d56 for instance c00a072c-e13e-4b90-b5f4-7341aea301b7 on hv-cinder-80382 Jun 15 14:51:32.471237 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-c1ddfc70-34a7-44bc-a67f-cfa2f4fc7c98 req-c7a212f1-b4a4-467a-a362-5592f59b3cd3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Jun 15 14:51:32.471921 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 384/758] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:33.430060 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:33.430711 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:33.434304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=26 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:33.438606 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:33.439096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:33.439915 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:33.440353 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:33.443223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=72 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:33.573035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:33.581192 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:33.582694 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:33.583873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-339b686c-9029-4566-9ecc-7f882209c162 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1743 microversion: 2.20 time: 0.157748 Jun 15 14:51:33.584460 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 375/759] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:33 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:34.603660 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:34.604389 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:34.606282 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=24 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:34.613562 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:34.614015 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:34.614782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:34.615250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:34.753764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:34.761759 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:34.763309 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:34.764458 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b1d00697-a53d-4fd0-936b-54a46efd1a7e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1743 microversion: 2.20 time: 0.166167 Jun 15 14:51:34.765019 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 385/760] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:34 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:35.782834 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:35.783467 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:35.790330 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:35.790779 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:35.791574 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:35.792008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:35.934675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:35.944146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:35.945772 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:35.947207 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-13ca9532-58f5-461d-b295-4846b0307c37 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1743 microversion: 2.20 time: 0.168122 Jun 15 14:51:35.947777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 376/761] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:35 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:36.967632 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:36.968235 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:36.974480 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:36.974937 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:36.975747 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:36.976184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:37.106765 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:37.115478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:37.116980 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:37.118126 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0f6059cd-7d39-4499-b216-1c1ee9d64e2e tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1743 microversion: 2.20 time: 0.154966 Jun 15 14:51:37.118689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 386/762] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:36 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:38.135786 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:38.136394 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:38.143637 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:38.144240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:38.145012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:38.145453 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:38.322381 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:38.336661 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:38.338267 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:38.339691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6429ef1d-fd0d-41bd-9224-afff2b251ad8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.208068 Jun 15 14:51:38.340239 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 377/763] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:38 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:39.358598 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:39.359150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:39.366314 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:39.366873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:39.367722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:39.368250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:39.532596 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:39.540873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:39.542390 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:39.543580 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8b65b317-4c95-4994-a888-85829a9c596b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.189453 Jun 15 14:51:39.544140 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 387/764] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:39 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:40.564087 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:40.564696 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:40.570729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:40.571215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:40.571975 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:40.572407 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:40.712053 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:40.720656 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:40.722190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:40.723407 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-728a95c4-e17c-414f-8beb-ecd1939db6cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.165136 Jun 15 14:51:40.723964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 378/765] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:40 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:41.742408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:41.743664 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:41.751783 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:41.751982 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:41.752819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:41.753434 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:42.036310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:42.049423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:42.053481 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:42.056405 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-360c67c7-2813-439b-8485-28c452ffe8b6 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.316994 Jun 15 14:51:42.071447 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 388/766] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:41 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:42.845931 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a1d23785-2fec-48d2-8841-37a41f9e4a74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:42.846469 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a1d23785-2fec-48d2-8841-37a41f9e4a74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:42.849176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-64b10a9f-382c-4a97-b59c-b343a6f84060 req-1bbd2854-7b24-4033-aec0-102d8b39d588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c32b0d85-8788-4ac8-9e61-faee2f6abee5", "tag": "532f4749-40c3-4e35-839e-07bfc3d097bb"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:42.853775 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a1d23785-2fec-48d2-8841-37a41f9e4a74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:42.854374 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a1d23785-2fec-48d2-8841-37a41f9e4a74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:42.855193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a1d23785-2fec-48d2-8841-37a41f9e4a74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:42.855638 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a1d23785-2fec-48d2-8841-37a41f9e4a74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:42.857366 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-64b10a9f-382c-4a97-b59c-b343a6f84060 req-1bbd2854-7b24-4033-aec0-102d8b39d588 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:42.858073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-64b10a9f-382c-4a97-b59c-b343a6f84060 req-1bbd2854-7b24-4033-aec0-102d8b39d588 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:42.870319 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-64b10a9f-382c-4a97-b59c-b343a6f84060 req-1bbd2854-7b24-4033-aec0-102d8b39d588 service nova] Creating event network-changed:532f4749-40c3-4e35-839e-07bfc3d097bb for instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 on hv-cinder-80382 Jun 15 14:51:42.877367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-64b10a9f-382c-4a97-b59c-b343a6f84060 req-1bbd2854-7b24-4033-aec0-102d8b39d588 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031658 Jun 15 14:51:42.878661 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 389/767] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:51:42.897387 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a1d23785-2fec-48d2-8841-37a41f9e4a74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:51:42.996651 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a1d23785-2fec-48d2-8841-37a41f9e4a74 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 204 len: 0 microversion: 2.1 time: 0.154490 Jun 15 14:51:43.011452 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5f785b67-2b26-4662-9721-c3676922af25 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:43.011733 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 379/768] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:51:42 2022] DELETE /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:51:43.012650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5f785b67-2b26-4662-9721-c3676922af25 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:43.030619 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5f785b67-2b26-4662-9721-c3676922af25 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:43.031025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5f785b67-2b26-4662-9721-c3676922af25 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:43.032213 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5f785b67-2b26-4662-9721-c3676922af25 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:43.033778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5f785b67-2b26-4662-9721-c3676922af25 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:43.095240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:43.096463 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:43.106972 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:43.109034 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:43.110714 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:43.112660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:43.295988 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5f785b67-2b26-4662-9721-c3676922af25 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:43.307877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5f785b67-2b26-4662-9721-c3676922af25 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.303316 Jun 15 14:51:43.308673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 390/769] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:43 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:43.332163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:43.341694 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:43.345942 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:43.348261 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1e55ee00-55f3-4810-87e1-57da9bbd5610 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.257618 Jun 15 14:51:43.349736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 380/770] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:43 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:44.329034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-69005c93-f788-4c43-85e9-e285c3988d26 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:44.329798 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-69005c93-f788-4c43-85e9-e285c3988d26 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:44.336001 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-69005c93-f788-4c43-85e9-e285c3988d26 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:44.336789 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-69005c93-f788-4c43-85e9-e285c3988d26 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:44.338424 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-69005c93-f788-4c43-85e9-e285c3988d26 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:44.339104 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-69005c93-f788-4c43-85e9-e285c3988d26 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:44.373091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:44.373466 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:44.397735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:44.398221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:44.400124 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:44.400783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:44.586331 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-69005c93-f788-4c43-85e9-e285c3988d26 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:44.593886 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-69005c93-f788-4c43-85e9-e285c3988d26 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1568 microversion: 2.1 time: 0.269209 Jun 15 14:51:44.597043 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 391/771] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:44 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:44.615311 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:44.624068 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:44.626226 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:44.627651 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-efc3c650-4370-4504-97e4-bd64220ce941 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.264055 Jun 15 14:51:44.628249 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 381/772] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:44 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:45.612464 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cebe0562-80e4-4c8e-9280-9c45db6c3c15 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:45.613874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cebe0562-80e4-4c8e-9280-9c45db6c3c15 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:45.621719 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cebe0562-80e4-4c8e-9280-9c45db6c3c15 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:45.622176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cebe0562-80e4-4c8e-9280-9c45db6c3c15 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:45.622975 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cebe0562-80e4-4c8e-9280-9c45db6c3c15 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:45.623471 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cebe0562-80e4-4c8e-9280-9c45db6c3c15 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:45.645706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:45.646920 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:45.653333 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:45.653810 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:45.654536 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:45.655175 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:45.867088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cebe0562-80e4-4c8e-9280-9c45db6c3c15 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:45.876948 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cebe0562-80e4-4c8e-9280-9c45db6c3c15 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1449 microversion: 2.1 time: 0.268982 Jun 15 14:51:45.880169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 392/773] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:45 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1449 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:45.893949 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:45.903943 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:45.905607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:45.907734 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1b8f9026-314a-4bb5-8849-97b46896ac17 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.265375 Jun 15 14:51:45.908379 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 382/774] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:45 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:46.440905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-a202e55a-4dc4-4a4c-810f-0c1a72844ec0 req-017c56f2-19cf-4a39-999a-de708467edd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32b0d85-8788-4ac8-9e61-faee2f6abee5", "name": "network-vif-deleted", "tag": "532f4749-40c3-4e35-839e-07bfc3d097bb"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:46.450083 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-a202e55a-4dc4-4a4c-810f-0c1a72844ec0 req-017c56f2-19cf-4a39-999a-de708467edd1 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:46.450397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-a202e55a-4dc4-4a4c-810f-0c1a72844ec0 req-017c56f2-19cf-4a39-999a-de708467edd1 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:46.463234 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-a202e55a-4dc4-4a4c-810f-0c1a72844ec0 req-017c56f2-19cf-4a39-999a-de708467edd1 service nova] Creating event network-vif-deleted:532f4749-40c3-4e35-839e-07bfc3d097bb for instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 on hv-cinder-80382 Jun 15 14:51:46.478795 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-a202e55a-4dc4-4a4c-810f-0c1a72844ec0 req-017c56f2-19cf-4a39-999a-de708467edd1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042091 Jun 15 14:51:46.479806 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 393/775] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:46.896649 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2cf034ee-2cf2-4939-835e-8ec136df7675 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:46.897429 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2cf034ee-2cf2-4939-835e-8ec136df7675 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:46.904061 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2cf034ee-2cf2-4939-835e-8ec136df7675 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:46.904738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2cf034ee-2cf2-4939-835e-8ec136df7675 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:46.905502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2cf034ee-2cf2-4939-835e-8ec136df7675 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:46.905931 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2cf034ee-2cf2-4939-835e-8ec136df7675 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:46.931282 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:46.932310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:46.939063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:46.939457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:46.940431 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:46.941021 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:47.002499 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2cf034ee-2cf2-4939-835e-8ec136df7675 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47f5d89bbb4d43844b1fb0794a3e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e38db34f53b4271ab5462a872e954ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:47.012304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2cf034ee-2cf2-4939-835e-8ec136df7675 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 200 len: 1218 microversion: 2.1 time: 0.119642 Jun 15 14:51:47.023196 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 383/776] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:46 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:47.107847 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:47.118084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:47.119648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:47.120806 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0ccdcad8-fd4a-4900-b3c9-9cac9ee40d7a tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.194700 Jun 15 14:51:47.121358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 394/777] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:46 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:48.030914 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:48.031657 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] [instance: c32b0d85-8788-4ac8-9e61-faee2f6abee5] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:48.038585 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.039285 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:48.040065 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.040666 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:48.057315 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] HTTP exception thrown: Instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 could not be found. Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Request method failure captured: Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 HTTP/1.1 Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfB8KYditINRKM1VqMXPEBF7o3OVvcjBs7yn3I7V1bU-EBR3BFSsRs19IxpAzAtwOEtjEsQETJP-36YyWIG7wMHQV51bjc0XLmOkHjD-0_gEjv1Hofsq5br7RNPG4-ofwsWriYPyMeqF3YO2i2yeWCg2Bvvh3VyVjMY0QV3Wl98E6CA Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 3e38db34f53b4271ab5462a872e954ef Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestShelveInstance-545955239 Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:51:48.059294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e38db34f53b4271ab5462a872e954ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3e38db34f53b4271ab5462a872e954ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3e38db34f53b4271ab5462a872e954ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e38db34f53b4271ab5462a872e954ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestShelveInstance-545955239 Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 3e38db34f53b4271ab5462a872e954ef Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestShelveInstance-545955239 Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-TestShelveInstance-545955239-project Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 5d47f5d89bbb4d43844b1fb0794a3e69 Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestShelveInstance-545955239-project Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 could not be found. Jun 15 14:51:48.060959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'c32b0d85-8788-4ac8-9e61-faee2f6abee5'} Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 could not be found. Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:48.061911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 could not be found. Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 could not be found. Jun 15 14:51:48.064206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.066274 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Returning 404 to user: Instance c32b0d85-8788-4ac8-9e61-faee2f6abee5 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:48.067329 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5a1fa0c3-d134-42e7-8ec2-3dd14fe7e008 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5" status: 404 len: 111 microversion: 2.1 time: 0.040393 Jun 15 14:51:48.067894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 384/778] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:48 2022] GET /compute/v2.1/servers/c32b0d85-8788-4ac8-9e61-faee2f6abee5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:48.140176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:48.140828 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:48.147166 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.147615 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:48.148384 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.148818 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:48.276100 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6017486a-5b04-4178-b5fb-861ff0df5d92 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] Calling method '.version_select at 0x7f05b76d7940>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:48.318379 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6017486a-5b04-4178-b5fb-861ff0df5d92 tempest-TestShelveInstance-545955239 tempest-TestShelveInstance-545955239-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576771872" status: 202 len: 0 microversion: 2.1 time: 0.048187 Jun 15 14:51:48.319419 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 385/779] 10.222.0.45 () {58 vars in 1250 bytes} [Wed Jun 15 14:51:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576771872 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:51:48.399627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:48.410657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:48.413314 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:48.414764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-84cd4072-37eb-4265-880f-d2cfeb421c21 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.279733 Jun 15 14:51:48.415573 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 395/780] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:48 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:49.444462 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:49.445120 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:49.492092 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:49.492833 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:49.493750 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:49.494325 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:49.673597 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:49.683681 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:49.685353 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:49.687031 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a766d1be-1afb-4b4f-a697-65bcc51723e4 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.254660 Jun 15 14:51:49.688966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 386/781] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:49 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:50.551077 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0579dc00-2b4c-4d69-957c-8c30b99e6e9a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:50.552519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0579dc00-2b4c-4d69-957c-8c30b99e6e9a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:50.566523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0579dc00-2b4c-4d69-957c-8c30b99e6e9a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.567376 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0579dc00-2b4c-4d69-957c-8c30b99e6e9a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.568578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0579dc00-2b4c-4d69-957c-8c30b99e6e9a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.569288 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0579dc00-2b4c-4d69-957c-8c30b99e6e9a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.609969 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0579dc00-2b4c-4d69-957c-8c30b99e6e9a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/ips" status: 200 len: 147 microversion: 2.1 time: 0.070235 Jun 15 14:51:50.611755 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 396/782] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 14:51:50 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/ips => generated 147 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:50.748467 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:50.752499 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:50.776012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.777231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.779113 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.780222 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:51.121983 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:51.134321 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:51.136601 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:51.138599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5223a36d-0f86-4b90-b401-512b52e58a67 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.419750 Jun 15 14:51:51.140003 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 387/783] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:50 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:52.158407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:52.159697 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:52.166523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.166912 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:52.167776 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.168210 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:52.347227 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:52.358225 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:52.359908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:52.361400 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-18a7b614-3358-488a-b899-e12203a15ded tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1738 microversion: 2.20 time: 0.207419 Jun 15 14:51:52.362052 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 397/784] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:52 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:53.368803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-64ba9e09-841c-4163-93eb-24618d7e68c7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ca811e9-e8c7-4315-b98f-835e1a8df99c"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:53.370131 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-64ba9e09-841c-4163-93eb-24618d7e68c7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:53.378021 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64ba9e09-841c-4163-93eb-24618d7e68c7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.378587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64ba9e09-841c-4163-93eb-24618d7e68c7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.379486 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64ba9e09-841c-4163-93eb-24618d7e68c7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.379671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:53.380163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64ba9e09-841c-4163-93eb-24618d7e68c7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.380432 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:53.387615 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.388152 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.389037 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.389513 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.653826 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:53.673314 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:53.676894 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:53.678201 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-619b988f-5ff8-4272-ad57-17f39e8633b2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1720 microversion: 2.20 time: 0.302924 Jun 15 14:51:53.679560 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 398/785] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:53 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1720 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:53.698511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-64ba9e09-841c-4163-93eb-24618d7e68c7 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333666 Jun 15 14:51:53.699306 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 388/786] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:51:53 2022] POST /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:54.697496 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:54.698016 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:54.704690 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.705146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.705927 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.706366 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.865515 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:54.873860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:54.875529 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:54.876915 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c7aaf57f-c49b-4150-a5f3-5232781e1790 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1720 microversion: 2.20 time: 0.183403 Jun 15 14:51:54.877507 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 399/787] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:54 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:55.899746 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:55.900562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:55.909502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:55.910199 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:55.911820 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:55.912719 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:56.159177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:56.173067 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:56.174753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:56.175793 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-111cad6f-3569-4f8e-a310-95c616c2b418 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1720 microversion: 2.20 time: 0.283558 Jun 15 14:51:56.176804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 389/788] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:55 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1720 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:56.642467 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-69ac11a4-c15b-472a-801c-faf4cd326358 req-0bf5f2e6-3e03-46f0-b3ed-b8989cda74fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00a072c-e13e-4b90-b5f4-7341aea301b7", "name": "network-vif-unplugged", "status": "completed", "tag": "5b328c6b-5677-47c6-b09a-974f22b96d56"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:56.652226 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-69ac11a4-c15b-472a-801c-faf4cd326358 req-0bf5f2e6-3e03-46f0-b3ed-b8989cda74fe service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:56.652672 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-69ac11a4-c15b-472a-801c-faf4cd326358 req-0bf5f2e6-3e03-46f0-b3ed-b8989cda74fe service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:56.666432 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-69ac11a4-c15b-472a-801c-faf4cd326358 req-0bf5f2e6-3e03-46f0-b3ed-b8989cda74fe service nova] Creating event network-vif-unplugged:5b328c6b-5677-47c6-b09a-974f22b96d56 for instance c00a072c-e13e-4b90-b5f4-7341aea301b7 on hv-cinder-80382 Jun 15 14:51:56.673363 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-69ac11a4-c15b-472a-801c-faf4cd326358 req-0bf5f2e6-3e03-46f0-b3ed-b8989cda74fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036226 Jun 15 14:51:56.674435 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 400/789] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:57.194190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:57.194801 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:57.201275 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.201702 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.202471 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.202907 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.220563 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:57.361161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:57.369194 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:57.370696 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:57.371872 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1177a91b-24ec-40f4-b67f-db9e0d526a75 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1663 microversion: 2.20 time: 0.181972 Jun 15 14:51:57.372437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 390/790] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:57 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1663 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:57.390089 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b4ea3659-fa19-416f-a4a1-d46784fe2cfb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaf43674-5ebf-43a6-833f-67f6d6bbbe7d"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:57.391696 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b4ea3659-fa19-416f-a4a1-d46784fe2cfb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:57.398051 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b4ea3659-fa19-416f-a4a1-d46784fe2cfb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.398507 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b4ea3659-fa19-416f-a4a1-d46784fe2cfb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.399351 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b4ea3659-fa19-416f-a4a1-d46784fe2cfb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.399782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b4ea3659-fa19-416f-a4a1-d46784fe2cfb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.645948 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:57.752665 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b4ea3659-fa19-416f-a4a1-d46784fe2cfb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.366765 Jun 15 14:51:57.753883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 401/791] 10.222.0.45 () {62 vars in 1363 bytes} [Wed Jun 15 14:51:57 2022] POST /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/os-volume_attachments => generated 188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:51:57.876106 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cc0dbb48-9ee4-470d-9157-2f0d3214ca4f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:57.876515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cc0dbb48-9ee4-470d-9157-2f0d3214ca4f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:57.882880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc0dbb48-9ee4-470d-9157-2f0d3214ca4f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.883366 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc0dbb48-9ee4-470d-9157-2f0d3214ca4f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.884200 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc0dbb48-9ee4-470d-9157-2f0d3214ca4f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.884639 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc0dbb48-9ee4-470d-9157-2f0d3214ca4f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.572037 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cc0dbb48-9ee4-470d-9157-2f0d3214ca4f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/os-volume_attachments/eaf43674-5ebf-43a6-833f-67f6d6bbbe7d" status: 202 len: 0 microversion: 2.20 time: 1.700539 Jun 15 14:51:59.572679 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 391/792] 10.222.0.45 () {60 vars in 1456 bytes} [Wed Jun 15 14:51:57 2022] DELETE /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/os-volume_attachments/eaf43674-5ebf-43a6-833f-67f6d6bbbe7d => generated 0 bytes in 1702 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:51:59.633213 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e97b7b78-68ee-4617-b1bd-d3229a28fdee tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:59.633780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e97b7b78-68ee-4617-b1bd-d3229a28fdee tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:59.640359 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e97b7b78-68ee-4617-b1bd-d3229a28fdee tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.641188 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e97b7b78-68ee-4617-b1bd-d3229a28fdee tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.641955 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e97b7b78-68ee-4617-b1bd-d3229a28fdee tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.642392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e97b7b78-68ee-4617-b1bd-d3229a28fdee tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.721016 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e97b7b78-68ee-4617-b1bd-d3229a28fdee tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "POST /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/action" status: 202 len: 0 microversion: 2.20 time: 0.091522 Jun 15 14:51:59.721890 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 402/793] 10.222.0.45 () {62 vars in 1318 bytes} [Wed Jun 15 14:51:59 2022] POST /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:51:59.730196 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:59.731480 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:59.739272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.739815 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.740664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.741027 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.885672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:59.894294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:59.895877 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:59.897084 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5c42f9ab-142a-49a2-9f3b-9cd74d48450f tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1671 microversion: 2.20 time: 0.170871 Jun 15 14:51:59.897637 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 392/794] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:59 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:00.916404 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:00.917011 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:00.923961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:00.924529 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:00.925407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:00.925915 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.061768 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:01.070279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:01.071830 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:01.072985 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-13340efa-80f2-42b0-9d93-9ce012071660 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1673 microversion: 2.20 time: 0.161227 Jun 15 14:52:01.073536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 403/795] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:00 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:02.093135 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:02.094538 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:02.101044 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.101494 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.102247 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.102674 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.235970 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:02.243915 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:02.245416 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:02.246556 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d78b17ae-ca05-4e2c-a118-342b46e00f85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.157397 Jun 15 14:52:02.247167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 393/796] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:02 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:03.264609 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:03.265269 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:03.272204 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.272653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.273418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.274221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.338602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-17a39168-5f5f-426e-8526-d00c2807624e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:03.339558 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-17a39168-5f5f-426e-8526-d00c2807624e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:03.348505 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17a39168-5f5f-426e-8526-d00c2807624e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.348964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17a39168-5f5f-426e-8526-d00c2807624e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.349825 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17a39168-5f5f-426e-8526-d00c2807624e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.350272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17a39168-5f5f-426e-8526-d00c2807624e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.384701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-17a39168-5f5f-426e-8526-d00c2807624e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051490 Jun 15 14:52:03.385269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 394/797] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:52:03 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:52:03.394851 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4894d91e-f160-47d9-a70f-a6fbc39b26a4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:03.395385 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4894d91e-f160-47d9-a70f-a6fbc39b26a4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:03.401432 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4894d91e-f160-47d9-a70f-a6fbc39b26a4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.401884 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4894d91e-f160-47d9-a70f-a6fbc39b26a4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.402718 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4894d91e-f160-47d9-a70f-a6fbc39b26a4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.403199 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4894d91e-f160-47d9-a70f-a6fbc39b26a4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.413588 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:03.422592 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:03.423888 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:03.425058 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2edaeb7a-4bb0-43f9-b43a-ded40bb763c7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.164328 Jun 15 14:52:03.425613 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 404/798] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:03 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:03.433970 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4894d91e-f160-47d9-a70f-a6fbc39b26a4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/7ca811e9-e8c7-4315-b98f-835e1a8df99c" status: 200 len: 194 microversion: 2.1 time: 0.042827 Jun 15 14:52:03.434554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 395/799] 10.222.0.45 () {58 vars in 1412 bytes} [Wed Jun 15 14:52:03 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/7ca811e9-e8c7-4315-b98f-835e1a8df99c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:52:04.442240 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:04.442859 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:04.449590 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:04.450043 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:04.450818 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:04.451283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:04.596381 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:04.612239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:04.614198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:04.616125 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ceb4df93-1db2-4a03-a351-249bbb6bed41 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.177183 Jun 15 14:52:04.616627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 405/800] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:04 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:05.642488 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:05.643328 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:05.647370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:05.654082 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.654536 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.655411 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.655854 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.799597 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:05.809055 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:05.810814 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:05.812410 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d9e30643-af0a-4859-ac2e-84bed1011662 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.174037 Jun 15 14:52:05.821141 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 396/801] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:05 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:06.830744 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:06.834226 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:06.845904 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=44 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:06.847902 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.848624 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:06.849403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.849840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:07.003864 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:07.013600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:07.016143 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:07.017744 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-22e1894f-4f8b-47e6-9cb0-fa8289fa74cb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.190964 Jun 15 14:52:07.018474 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 406/802] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:06 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:07.942277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5a9bd0e3-45ae-4bc1-afe7-1104a022f9fa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4f9584d-b141-4cf8-951f-05cf9daeb0d9"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:07.943432 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5a9bd0e3-45ae-4bc1-afe7-1104a022f9fa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:07.950187 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a9bd0e3-45ae-4bc1-afe7-1104a022f9fa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:07.950642 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a9bd0e3-45ae-4bc1-afe7-1104a022f9fa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:07.951511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a9bd0e3-45ae-4bc1-afe7-1104a022f9fa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:07.951946 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5a9bd0e3-45ae-4bc1-afe7-1104a022f9fa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.036428 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:08.037439 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:08.045745 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:08.046454 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.047581 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:08.048171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.205069 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:08.214034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:08.215594 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:08.217039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9b627a09-12c0-4a58-81b2-9a38755f7786 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.184972 Jun 15 14:52:08.218133 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 407/803] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:08 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:09.236521 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:09.237184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:09.244190 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:09.244639 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:09.245407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:09.245839 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:09.397215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:09.406666 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:09.408571 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:09.409742 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-06a5b93a-a8f1-4ee3-802f-c03042949b85 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.177687 Jun 15 14:52:09.410298 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 408/804] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:09 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:10.430671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:10.431426 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:10.440322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:10.440891 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:10.441748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:10.442259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:10.624062 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:10.632544 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:10.634086 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:10.635406 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6cb84528-efa2-4827-ab9f-524ebdffbe29 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.209973 Jun 15 14:52:10.636035 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 409/805] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:10 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:11.653668 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:11.654379 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:11.661259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:11.661707 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:11.662744 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:11.663209 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:11.825212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:11.834910 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:11.836502 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:11.837884 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c4dd74d0-a6a1-40f5-bfb6-292ed8961b2b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.187945 Jun 15 14:52:11.838594 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 410/806] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:11 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:12.856385 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:12.857064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:12.863505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:12.863951 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:12.864710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:12.865144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:12.991943 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:12.999826 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:13.001343 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:13.002491 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2d4892cb-bf30-4277-b5d1-c9cc8a53e4b0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.150049 Jun 15 14:52:13.003072 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 411/807] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:12 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:14.020616 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:14.021253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:14.027728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:14.028186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:14.028945 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:14.029408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:14.178981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:14.199918 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:14.201430 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:14.203150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5d604edc-cc67-4a3a-800c-efff06c69214 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.185983 Jun 15 14:52:14.213472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 412/808] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:14 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:15.220962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:15.221651 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:15.228072 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:15.228515 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:15.229271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:15.229705 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:15.360392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:15.368278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:15.369778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:15.370910 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-eed49ba5-b04e-4880-a608-cf50aa64810b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.153992 Jun 15 14:52:15.371490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 413/809] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:15 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:16.389769 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:16.394139 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:16.398326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.398782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.399602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.400044 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.535429 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:16.543782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:16.545294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:16.546451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f5bb7680-8106-4b66-981d-24da0ce4ffbd tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.160651 Jun 15 14:52:16.547536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 414/810] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:16 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:17.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:17.566662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:17.573205 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:17.573654 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:17.574402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:17.574832 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:17.706817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:17.714779 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:17.716301 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:17.717441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e83ae828-6f17-435f-877d-8165bac63745 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.155933 Jun 15 14:52:17.718441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 415/811] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:17 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:17.948299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:18.026928 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:18.737012 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:18.737614 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:18.744079 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:18.744527 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:18.745281 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:18.745710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:18.880114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:18.882271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:18.889203 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:18.890706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:18.891880 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a4cbba88-df2f-448f-827b-b5ad5df40acb tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.159562 Jun 15 14:52:18.892435 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 416/812] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:18 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:19.911825 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:19.912917 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:19.920059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:19.920517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:19.921487 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:19.921972 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:20.055862 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:20.063998 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:20.065557 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:20.066724 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-95ea8e19-ae5e-42cb-af01-8cb050220ef7 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.159514 Jun 15 14:52:20.067312 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 417/813] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:19 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:20.484767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5a9bd0e3-45ae-4bc1-afe7-1104a022f9fa tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "POST /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.547189 Jun 15 14:52:20.485570 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 397/814] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:52:07 2022] POST /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments => generated 194 bytes in 12549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:21.084994 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:21.085586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:21.092122 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:21.092575 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:21.093328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:21.093957 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:21.222557 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:21.230517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:21.232068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:21.233221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1c715ea1-94c1-4797-90e0-c3f63a7d9b72 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.152108 Jun 15 14:52:21.233869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 418/815] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:21 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:22.251640 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:22.252371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:22.259591 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:22.260041 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:22.260802 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:22.261261 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:22.397304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:22.405284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:22.407367 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:22.408522 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1ff9ed3c-fb98-4f45-bb45-9f1f9849073b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.161182 Jun 15 14:52:22.409084 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 398/816] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:22 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:23.430914 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:23.431841 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:23.442154 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:23.442875 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:23.444163 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:23.444887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:23.579461 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:23.587826 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:23.589335 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:23.590502 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5d1be89f-7d99-4506-9d41-5444017b90b8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.166550 Jun 15 14:52:23.591098 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 419/817] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:23 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:24.610301 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:24.611384 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:24.617752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:24.618194 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:24.618968 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:24.619423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:24.777799 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-610fb3cd-4707-4085-acd1-1af3a6ff0aa9 req-3d182fd3-75fa-4ffa-ba19-470821f6967b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00a072c-e13e-4b90-b5f4-7341aea301b7", "name": "network-vif-plugged", "status": "completed", "tag": "5b328c6b-5677-47c6-b09a-974f22b96d56"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:24.793368 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-610fb3cd-4707-4085-acd1-1af3a6ff0aa9 req-3d182fd3-75fa-4ffa-ba19-470821f6967b service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:24.794203 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-610fb3cd-4707-4085-acd1-1af3a6ff0aa9 req-3d182fd3-75fa-4ffa-ba19-470821f6967b service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:24.807497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-610fb3cd-4707-4085-acd1-1af3a6ff0aa9 req-3d182fd3-75fa-4ffa-ba19-470821f6967b service nova] Creating event network-vif-plugged:5b328c6b-5677-47c6-b09a-974f22b96d56 for instance c00a072c-e13e-4b90-b5f4-7341aea301b7 on hv-cinder-80382 Jun 15 14:52:24.813522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-610fb3cd-4707-4085-acd1-1af3a6ff0aa9 req-3d182fd3-75fa-4ffa-ba19-470821f6967b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038801 Jun 15 14:52:24.814740 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 420/818] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:52:24.827432 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:24.850438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:24.852599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:24.854343 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-01f40e97-6810-4b68-985e-560f1cdc706b tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.248416 Jun 15 14:52:24.854950 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 399/819] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:24 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:25.877227 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:25.878174 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:25.885408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:25.885822 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:25.886882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:25.887363 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:26.057229 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:26.066409 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:26.067956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:26.069123 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2e8bf7ac-4d1b-4808-ac05-9087a6997dec tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.199000 Jun 15 14:52:26.069681 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 421/820] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:25 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:27.089055 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:27.090027 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:27.099411 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:27.100309 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:27.100939 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:27.101320 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:27.262187 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:27.270284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:27.271780 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:27.273176 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e800340c-a63a-4b3a-a47d-5208af1e4749 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.188817 Jun 15 14:52:27.273687 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 400/821] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:27 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:27.917120 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-762716806", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "networks": [{"uuid": "159ca85e-e8a2-4554-b820-1789a23ee856"}]}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:27.971410 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] validate_networks() for [('159ca85e-e8a2-4554-b820-1789a23ee856', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:52:28.291926 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:28.292529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:28.308415 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:28.309152 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:28.309932 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:28.310412 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:28.331578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:52:28.332005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:52:28.332475 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:52:28.332881 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:52:28.333289 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:52:28.342247 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:28.342690 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:28.343517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:28.343946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:28.361474 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Getting quotas for project 28dfd45278d84a798da8e77bf7e6bc9d. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:52:28.365419 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Getting quotas for user 235cd365a5ab41cda9bffd0cee150617 and project 28dfd45278d84a798da8e77bf7e6bc9d. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:52:28.377418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:52:28.379795 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:52:28.426292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-424bb152-1931-4531-b974-59285d200f06 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512974 Jun 15 14:52:28.427164 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 422/822] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:52:28.437089 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f23f6680-622c-41ef-9b61-261b09a21b86 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:28.439030 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f23f6680-622c-41ef-9b61-261b09a21b86 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:28.449579 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:28.458895 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:28.460495 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:28.461659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3553bcee-d259-4686-9f97-8aef7630b8fe tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1729 microversion: 2.20 time: 0.173617 Jun 15 14:52:28.471095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 401/823] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:28 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:28.505161 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f23f6680-622c-41ef-9b61-261b09a21b86 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:28.512847 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f23f6680-622c-41ef-9b61-261b09a21b86 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1218 microversion: 2.1 time: 0.079562 Jun 15 14:52:28.513737 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 423/824] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:28 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:29.078086 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f9e1bc76-31fb-41a9-9659-134b873b4222 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:29.079171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f9e1bc76-31fb-41a9-9659-134b873b4222 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:29.085351 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9e1bc76-31fb-41a9-9659-134b873b4222 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.085798 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9e1bc76-31fb-41a9-9659-134b873b4222 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.086568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9e1bc76-31fb-41a9-9659-134b873b4222 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.087031 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9e1bc76-31fb-41a9-9659-134b873b4222 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.119159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f9e1bc76-31fb-41a9-9659-134b873b4222 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045122 Jun 15 14:52:29.119734 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 402/825] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:52:29 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:29.264054 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-bd04b3ac-68ce-4ed4-ae8c-60a9d0d24083 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:29.264640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bd04b3ac-68ce-4ed4-ae8c-60a9d0d24083 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:29.272208 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bd04b3ac-68ce-4ed4-ae8c-60a9d0d24083 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.272655 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bd04b3ac-68ce-4ed4-ae8c-60a9d0d24083 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.273417 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bd04b3ac-68ce-4ed4-ae8c-60a9d0d24083 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.273848 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bd04b3ac-68ce-4ed4-ae8c-60a9d0d24083 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.302828 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-bd04b3ac-68ce-4ed4-ae8c-60a9d0d24083 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/7ca811e9-e8c7-4315-b98f-835e1a8df99c" status: 200 len: 194 microversion: 2.1 time: 0.042680 Jun 15 14:52:29.303349 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 424/826] 10.222.0.45 () {58 vars in 1412 bytes} [Wed Jun 15 14:52:29 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/7ca811e9-e8c7-4315-b98f-835e1a8df99c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:29.312959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0313aa52-95f4-4750-8b82-de539335de6e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:29.313440 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0313aa52-95f4-4750-8b82-de539335de6e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:29.319851 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0313aa52-95f4-4750-8b82-de539335de6e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.320301 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0313aa52-95f4-4750-8b82-de539335de6e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.321070 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0313aa52-95f4-4750-8b82-de539335de6e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.321503 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0313aa52-95f4-4750-8b82-de539335de6e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.408077 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-0313aa52-95f4-4750-8b82-de539335de6e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lazy-loading 'services' on Instance uuid ed0d4bf9-714b-4617-a166-8a8930710d3d {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:52:29.480775 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0313aa52-95f4-4750-8b82-de539335de6e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/7ca811e9-e8c7-4315-b98f-835e1a8df99c" status: 202 len: 0 microversion: 2.1 time: 0.171453 Jun 15 14:52:29.481376 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 403/827] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 14:52:29 2022] DELETE /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/7ca811e9-e8c7-4315-b98f-835e1a8df99c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:52:29.481512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:29.482076 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:29.489059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.489502 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.490490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.490924 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.530796 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-97f9d2cb-2b25-4083-a722-ef4bbc19482f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:29.532318 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-97f9d2cb-2b25-4083-a722-ef4bbc19482f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:29.542836 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-97f9d2cb-2b25-4083-a722-ef4bbc19482f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.543659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-97f9d2cb-2b25-4083-a722-ef4bbc19482f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.544457 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-97f9d2cb-2b25-4083-a722-ef4bbc19482f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.545037 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-97f9d2cb-2b25-4083-a722-ef4bbc19482f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.631569 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-97f9d2cb-2b25-4083-a722-ef4bbc19482f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:29.641357 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-97f9d2cb-2b25-4083-a722-ef4bbc19482f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1270 microversion: 2.1 time: 0.114575 Jun 15 14:52:29.642012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 404/828] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:29 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:29.672860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:29.681821 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:29.683837 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:29.685244 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-78363fb2-d22c-44ba-8322-90eb6b6ffbf0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1716 microversion: 2.20 time: 0.208867 Jun 15 14:52:29.686394 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 425/829] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:29 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1716 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:30.661222 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-14f403f0-a1cd-4587-a126-116cf74de9d1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:30.661839 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-14f403f0-a1cd-4587-a126-116cf74de9d1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:30.674408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-14f403f0-a1cd-4587-a126-116cf74de9d1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:30.674725 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-14f403f0-a1cd-4587-a126-116cf74de9d1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:30.675552 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-14f403f0-a1cd-4587-a126-116cf74de9d1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:30.675989 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-14f403f0-a1cd-4587-a126-116cf74de9d1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:30.820918 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-14f403f0-a1cd-4587-a126-116cf74de9d1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:30.829064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-14f403f0-a1cd-4587-a126-116cf74de9d1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1318 microversion: 2.1 time: 0.171725 Jun 15 14:52:30.829756 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 405/830] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:30 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:31.360458 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-f53800b1-db0c-4133-85a1-b5a68da10036 req-35f5c856-2915-4a99-8a77-50220f674bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf2056c-e005-4212-aaaa-db59d3c77f48", "tag": "40c19e7c-4495-43ec-b690-60fe02d5ec44"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:31.370065 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-f53800b1-db0c-4133-85a1-b5a68da10036 req-35f5c856-2915-4a99-8a77-50220f674bae service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:31.370524 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-f53800b1-db0c-4133-85a1-b5a68da10036 req-35f5c856-2915-4a99-8a77-50220f674bae service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:31.384816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-f53800b1-db0c-4133-85a1-b5a68da10036 req-35f5c856-2915-4a99-8a77-50220f674bae service nova] Creating event network-changed:40c19e7c-4495-43ec-b690-60fe02d5ec44 for instance 1bf2056c-e005-4212-aaaa-db59d3c77f48 on hv-cinder-80382 Jun 15 14:52:31.389604 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-f53800b1-db0c-4133-85a1-b5a68da10036 req-35f5c856-2915-4a99-8a77-50220f674bae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033896 Jun 15 14:52:31.390205 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 426/831] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:52:31.663767 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b8b6ba47-31cf-4167-85ed-6469549a01f1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:31.664328 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b8b6ba47-31cf-4167-85ed-6469549a01f1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:31.670821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8b6ba47-31cf-4167-85ed-6469549a01f1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:31.671317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8b6ba47-31cf-4167-85ed-6469549a01f1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:31.672120 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8b6ba47-31cf-4167-85ed-6469549a01f1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:31.672565 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8b6ba47-31cf-4167-85ed-6469549a01f1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:31.701918 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b8b6ba47-31cf-4167-85ed-6469549a01f1 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/d4f9584d-b141-4cf8-951f-05cf9daeb0d9" status: 200 len: 194 microversion: 2.1 time: 0.042332 Jun 15 14:52:31.702529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 406/832] 10.222.0.45 () {58 vars in 1412 bytes} [Wed Jun 15 14:52:31 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/d4f9584d-b141-4cf8-951f-05cf9daeb0d9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:31.713440 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b5920f91-e9f6-486d-84db-bcdcdf431d87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:31.714024 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b5920f91-e9f6-486d-84db-bcdcdf431d87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:31.720873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5920f91-e9f6-486d-84db-bcdcdf431d87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:31.721328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5920f91-e9f6-486d-84db-bcdcdf431d87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:31.722106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5920f91-e9f6-486d-84db-bcdcdf431d87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:31.722551 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5920f91-e9f6-486d-84db-bcdcdf431d87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:31.807362 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-b5920f91-e9f6-486d-84db-bcdcdf431d87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lazy-loading 'services' on Instance uuid ed0d4bf9-714b-4617-a166-8a8930710d3d {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:52:31.846678 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-55a42b2d-9479-4b77-9900-00c372f26258 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:31.847382 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-55a42b2d-9479-4b77-9900-00c372f26258 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:31.853517 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55a42b2d-9479-4b77-9900-00c372f26258 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:31.853903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55a42b2d-9479-4b77-9900-00c372f26258 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:31.854693 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55a42b2d-9479-4b77-9900-00c372f26258 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:31.855163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55a42b2d-9479-4b77-9900-00c372f26258 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:31.896352 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b5920f91-e9f6-486d-84db-bcdcdf431d87 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/d4f9584d-b141-4cf8-951f-05cf9daeb0d9" status: 202 len: 0 microversion: 2.1 time: 0.186846 Jun 15 14:52:31.897942 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 427/833] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 14:52:31 2022] DELETE /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments/d4f9584d-b141-4cf8-951f-05cf9daeb0d9 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:52:31.997914 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-55a42b2d-9479-4b77-9900-00c372f26258 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:32.005964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-55a42b2d-9479-4b77-9900-00c372f26258 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1318 microversion: 2.1 time: 0.163960 Jun 15 14:52:32.006522 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 407/834] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:31 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:33.023233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b74fac83-69e0-45e9-b075-c0dbb13ce416 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:33.023927 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b74fac83-69e0-45e9-b075-c0dbb13ce416 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:33.030233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b74fac83-69e0-45e9-b075-c0dbb13ce416 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:33.030676 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b74fac83-69e0-45e9-b075-c0dbb13ce416 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:33.032082 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b74fac83-69e0-45e9-b075-c0dbb13ce416 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:33.032513 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b74fac83-69e0-45e9-b075-c0dbb13ce416 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:33.166415 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b74fac83-69e0-45e9-b075-c0dbb13ce416 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:33.173809 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b74fac83-69e0-45e9-b075-c0dbb13ce416 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1318 microversion: 2.1 time: 0.155256 Jun 15 14:52:33.174720 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 428/835] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:33 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:34.189779 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-737ab34a-a655-42ed-b07d-4dd181e70e70 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:34.190395 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-737ab34a-a655-42ed-b07d-4dd181e70e70 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:34.196940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-737ab34a-a655-42ed-b07d-4dd181e70e70 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:34.197393 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-737ab34a-a655-42ed-b07d-4dd181e70e70 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:34.198166 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-737ab34a-a655-42ed-b07d-4dd181e70e70 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:34.198605 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-737ab34a-a655-42ed-b07d-4dd181e70e70 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:34.327025 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-737ab34a-a655-42ed-b07d-4dd181e70e70 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:34.334412 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-737ab34a-a655-42ed-b07d-4dd181e70e70 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1318 microversion: 2.1 time: 0.148579 Jun 15 14:52:34.334986 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 408/836] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:34 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:35.353682 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-22c9db36-699f-4423-b0d3-114a3771a588 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:35.354364 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-22c9db36-699f-4423-b0d3-114a3771a588 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:35.364120 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22c9db36-699f-4423-b0d3-114a3771a588 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:35.364569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22c9db36-699f-4423-b0d3-114a3771a588 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:35.365374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22c9db36-699f-4423-b0d3-114a3771a588 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:35.365808 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-22c9db36-699f-4423-b0d3-114a3771a588 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:35.504722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-22c9db36-699f-4423-b0d3-114a3771a588 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:35.512028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-22c9db36-699f-4423-b0d3-114a3771a588 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1318 microversion: 2.1 time: 0.163459 Jun 15 14:52:35.512593 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 429/837] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:35 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:36.230482 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-64bc6aaf-b8f8-41ce-9543-77be5a75fda2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:36.231543 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-64bc6aaf-b8f8-41ce-9543-77be5a75fda2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:36.237985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64bc6aaf-b8f8-41ce-9543-77be5a75fda2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.238447 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64bc6aaf-b8f8-41ce-9543-77be5a75fda2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.239243 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64bc6aaf-b8f8-41ce-9543-77be5a75fda2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.239683 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-64bc6aaf-b8f8-41ce-9543-77be5a75fda2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.267813 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-64bc6aaf-b8f8-41ce-9543-77be5a75fda2 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041363 Jun 15 14:52:36.268360 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 409/838] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:52:36 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:52:36.379607 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6208338e-468c-49da-9f73-a7b8295d9a69 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:36.382303 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6208338e-468c-49da-9f73-a7b8295d9a69 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:36.390313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6208338e-468c-49da-9f73-a7b8295d9a69 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.390759 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6208338e-468c-49da-9f73-a7b8295d9a69 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.392166 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6208338e-468c-49da-9f73-a7b8295d9a69 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.392599 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6208338e-468c-49da-9f73-a7b8295d9a69 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.530377 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-069fc949-59d9-4049-8450-4ec9690fb8fc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:36.531438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-069fc949-59d9-4049-8450-4ec9690fb8fc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:36.540082 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-069fc949-59d9-4049-8450-4ec9690fb8fc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.540601 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-069fc949-59d9-4049-8450-4ec9690fb8fc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.541556 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-069fc949-59d9-4049-8450-4ec9690fb8fc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.542072 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-069fc949-59d9-4049-8450-4ec9690fb8fc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.572448 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6208338e-468c-49da-9f73-a7b8295d9a69 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.201267 Jun 15 14:52:36.573002 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 430/839] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:52:36 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d/os-volume_attachments => generated 25 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:52:36.633018 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-40e893fd-f648-4836-98fc-0c4bfd46a76c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:36.633438 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-40e893fd-f648-4836-98fc-0c4bfd46a76c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:36.639565 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-40e893fd-f648-4836-98fc-0c4bfd46a76c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.640016 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-40e893fd-f648-4836-98fc-0c4bfd46a76c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.640782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-40e893fd-f648-4836-98fc-0c4bfd46a76c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.641241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-40e893fd-f648-4836-98fc-0c4bfd46a76c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.674534 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-40e893fd-f648-4836-98fc-0c4bfd46a76c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:52:36.687976 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-069fc949-59d9-4049-8450-4ec9690fb8fc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:36.696064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-069fc949-59d9-4049-8450-4ec9690fb8fc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1318 microversion: 2.1 time: 0.170648 Jun 15 14:52:36.696634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 410/840] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:36 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:36.766207 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-40e893fd-f648-4836-98fc-0c4bfd46a76c tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 204 len: 0 microversion: 2.1 time: 0.135919 Jun 15 14:52:36.768555 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 431/841] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:52:36 2022] DELETE /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 14:52:36.778332 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c7d9fe0f-bd0b-4c62-9782-a176b8b2b18e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:36.779170 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c7d9fe0f-bd0b-4c62-9782-a176b8b2b18e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:36.788482 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c7d9fe0f-bd0b-4c62-9782-a176b8b2b18e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.790586 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c7d9fe0f-bd0b-4c62-9782-a176b8b2b18e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.791976 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c7d9fe0f-bd0b-4c62-9782-a176b8b2b18e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.793020 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c7d9fe0f-bd0b-4c62-9782-a176b8b2b18e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.951429 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c7d9fe0f-bd0b-4c62-9782-a176b8b2b18e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:36.960437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c7d9fe0f-bd0b-4c62-9782-a176b8b2b18e tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1676 microversion: 2.1 time: 0.187397 Jun 15 14:52:36.961023 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 411/842] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:36 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:37.714192 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-67531d66-8fca-4918-a9b7-2f4994bd0cf5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:37.714889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-67531d66-8fca-4918-a9b7-2f4994bd0cf5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:37.717522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:37.723396 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-67531d66-8fca-4918-a9b7-2f4994bd0cf5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.723850 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-67531d66-8fca-4918-a9b7-2f4994bd0cf5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:37.724618 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-67531d66-8fca-4918-a9b7-2f4994bd0cf5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.725054 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-67531d66-8fca-4918-a9b7-2f4994bd0cf5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:37.859386 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-67531d66-8fca-4918-a9b7-2f4994bd0cf5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:37.866733 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-67531d66-8fca-4918-a9b7-2f4994bd0cf5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1318 microversion: 2.1 time: 0.156793 Jun 15 14:52:37.867331 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 432/843] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:37 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:37.977666 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-492c0f93-7971-435c-9eb0-8e43fc1eee0a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:37.978272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-492c0f93-7971-435c-9eb0-8e43fc1eee0a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:37.985075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-492c0f93-7971-435c-9eb0-8e43fc1eee0a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.985525 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-492c0f93-7971-435c-9eb0-8e43fc1eee0a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:37.986280 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-492c0f93-7971-435c-9eb0-8e43fc1eee0a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.986715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-492c0f93-7971-435c-9eb0-8e43fc1eee0a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:38.005004 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:38.115922 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-492c0f93-7971-435c-9eb0-8e43fc1eee0a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:38.123281 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-492c0f93-7971-435c-9eb0-8e43fc1eee0a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1676 microversion: 2.1 time: 0.149490 Jun 15 14:52:38.123879 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 412/844] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:37 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:38.882743 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-c1033a53-de88-43c3-9b34-ab5300c5e61a req-22f3ba64-aaee-4edd-bb15-c3500534b2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf2056c-e005-4212-aaaa-db59d3c77f48", "name": "network-vif-plugged", "status": "completed", "tag": "40c19e7c-4495-43ec-b690-60fe02d5ec44"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:38.883805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5352278c-eb25-42da-ba81-d2e98c07cfdc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:38.884420 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5352278c-eb25-42da-ba81-d2e98c07cfdc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:38.886155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:38.886912 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=8 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:38.890688 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5352278c-eb25-42da-ba81-d2e98c07cfdc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:38.891387 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5352278c-eb25-42da-ba81-d2e98c07cfdc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:38.892010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5352278c-eb25-42da-ba81-d2e98c07cfdc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:38.892535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5352278c-eb25-42da-ba81-d2e98c07cfdc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:38.893889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c1033a53-de88-43c3-9b34-ab5300c5e61a req-22f3ba64-aaee-4edd-bb15-c3500534b2b1 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:38.894343 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-c1033a53-de88-43c3-9b34-ab5300c5e61a req-22f3ba64-aaee-4edd-bb15-c3500534b2b1 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:38.907570 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-c1033a53-de88-43c3-9b34-ab5300c5e61a req-22f3ba64-aaee-4edd-bb15-c3500534b2b1 service nova] Creating event network-vif-plugged:40c19e7c-4495-43ec-b690-60fe02d5ec44 for instance 1bf2056c-e005-4212-aaaa-db59d3c77f48 on hv-cinder-80382 Jun 15 14:52:38.912595 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-c1033a53-de88-43c3-9b34-ab5300c5e61a req-22f3ba64-aaee-4edd-bb15-c3500534b2b1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Jun 15 14:52:38.913182 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 433/845] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:39.027071 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5352278c-eb25-42da-ba81-d2e98c07cfdc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:39.035308 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5352278c-eb25-42da-ba81-d2e98c07cfdc tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1318 microversion: 2.1 time: 0.155512 Jun 15 14:52:39.035873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 413/846] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:38 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:39.141923 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-54c1164b-18fa-487e-9358-42acbbfaebd0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:39.142575 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-54c1164b-18fa-487e-9358-42acbbfaebd0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:39.149073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-54c1164b-18fa-487e-9358-42acbbfaebd0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:39.149524 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-54c1164b-18fa-487e-9358-42acbbfaebd0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:39.150287 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-54c1164b-18fa-487e-9358-42acbbfaebd0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:39.150724 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-54c1164b-18fa-487e-9358-42acbbfaebd0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:39.280236 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-54c1164b-18fa-487e-9358-42acbbfaebd0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:39.282623 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:39.289898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-54c1164b-18fa-487e-9358-42acbbfaebd0 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1676 microversion: 2.1 time: 0.152717 Jun 15 14:52:39.290464 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 434/847] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:39 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:40.052274 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d194d588-a1dc-4783-9dc2-a474a4843813 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:40.052890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d194d588-a1dc-4783-9dc2-a474a4843813 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:40.059634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d194d588-a1dc-4783-9dc2-a474a4843813 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:40.060108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d194d588-a1dc-4783-9dc2-a474a4843813 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.060978 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d194d588-a1dc-4783-9dc2-a474a4843813 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:40.061420 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d194d588-a1dc-4783-9dc2-a474a4843813 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.187029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d194d588-a1dc-4783-9dc2-a474a4843813 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:40.194911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d194d588-a1dc-4783-9dc2-a474a4843813 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1318 microversion: 2.1 time: 0.146511 Jun 15 14:52:40.195511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 414/848] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:40 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:40.307548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-990dc8ca-4d48-4caa-9d82-b6be36571a40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:40.308166 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-990dc8ca-4d48-4caa-9d82-b6be36571a40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:40.316238 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-990dc8ca-4d48-4caa-9d82-b6be36571a40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:40.316696 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-990dc8ca-4d48-4caa-9d82-b6be36571a40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.317469 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-990dc8ca-4d48-4caa-9d82-b6be36571a40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:40.317920 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-990dc8ca-4d48-4caa-9d82-b6be36571a40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.451635 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-990dc8ca-4d48-4caa-9d82-b6be36571a40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:40.459101 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-990dc8ca-4d48-4caa-9d82-b6be36571a40 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1676 microversion: 2.1 time: 0.155429 Jun 15 14:52:40.459657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 435/849] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:40 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:41.212161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c3b9d664-096c-47cd-a69a-e20fcb0f222e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:41.212771 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c3b9d664-096c-47cd-a69a-e20fcb0f222e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:41.219172 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c3b9d664-096c-47cd-a69a-e20fcb0f222e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.219666 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c3b9d664-096c-47cd-a69a-e20fcb0f222e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.221348 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c3b9d664-096c-47cd-a69a-e20fcb0f222e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.221997 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c3b9d664-096c-47cd-a69a-e20fcb0f222e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.300355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-e82a61e6-2b1b-466c-a27d-41b9678074de req-1277470e-35d0-421e-b0ca-cfe37bd7c21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0d4bf9-714b-4617-a166-8a8930710d3d", "name": "network-vif-deleted", "tag": "2af28279-f13c-4914-a2a0-7a1481f5364e"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:41.308320 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-e82a61e6-2b1b-466c-a27d-41b9678074de req-1277470e-35d0-421e-b0ca-cfe37bd7c21e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.309451 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-e82a61e6-2b1b-466c-a27d-41b9678074de req-1277470e-35d0-421e-b0ca-cfe37bd7c21e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.322773 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-e82a61e6-2b1b-466c-a27d-41b9678074de req-1277470e-35d0-421e-b0ca-cfe37bd7c21e service nova] Creating event network-vif-deleted:2af28279-f13c-4914-a2a0-7a1481f5364e for instance ed0d4bf9-714b-4617-a166-8a8930710d3d on hv-cinder-80382 Jun 15 14:52:41.328159 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-e82a61e6-2b1b-466c-a27d-41b9678074de req-1277470e-35d0-421e-b0ca-cfe37bd7c21e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031370 Jun 15 14:52:41.328755 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 436/850] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:52:41.358341 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c3b9d664-096c-47cd-a69a-e20fcb0f222e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:41.366320 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c3b9d664-096c-47cd-a69a-e20fcb0f222e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1507 microversion: 2.1 time: 0.158032 Jun 15 14:52:41.367228 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 415/851] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:41 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:41.477124 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8009e132-9b2c-4922-af00-14f4dd67014b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:41.478100 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8009e132-9b2c-4922-af00-14f4dd67014b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:41.485524 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8009e132-9b2c-4922-af00-14f4dd67014b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.486031 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8009e132-9b2c-4922-af00-14f4dd67014b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.486829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8009e132-9b2c-4922-af00-14f4dd67014b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.487478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8009e132-9b2c-4922-af00-14f4dd67014b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.571266 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8009e132-9b2c-4922-af00-14f4dd67014b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efb0951ba1144d58698e02e0e5e9416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ce7cecd2f4983b8442f70ed2afdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:41.580375 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8009e132-9b2c-4922-af00-14f4dd67014b tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 200 len: 1608 microversion: 2.1 time: 0.107469 Jun 15 14:52:41.581218 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 437/852] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:41 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 1608 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:42.599323 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:42.600141 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:42.612266 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:42.612712 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:42.613486 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:42.613913 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:42.628699 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] HTTP exception thrown: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Request method failure captured: Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d HTTP/1.1 Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_xFdwFsqv3FK89kRl4PykrTW20fdrlQjVV8tsSasc6cRQb2zMIKlvmcE_Oh2YddlKGogHNrn1Y9-eVMkJrJsxMGaW5eJTOzsy0dN2wNxnWOXY6TMxeNiIOHp7YhAfitIGoLf-a0-NUGlNTMHzqFOH6B4Vc-FSbhMxgeQvYecidDPw Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:52:42.630345 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1efb0951ba1144d58698e02e0e5e9416 Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:42.632022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'ed0d4bf9-714b-4617-a166-8a8930710d3d'} Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:42.633038 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:42.634595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:42.636091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Returning 404 to user: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:42.636091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-12df9143-9beb-49a1-8459-bd7b3de30b6a tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 404 len: 111 microversion: 2.1 time: 0.038037 Jun 15 14:52:42.636091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 416/853] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:42 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:42.640601 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a7281f40-c496-4e32-9acc-2c6b3d2943d4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '.version_select at 0x7f05b7631dc0>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:42.658278 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a7281f40-c496-4e32-9acc-2c6b3d2943d4 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557763080" status: 202 len: 0 microversion: 2.1 time: 0.020967 Jun 15 14:52:42.658854 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 438/854] 10.222.0.45 () {58 vars in 1220 bytes} [Wed Jun 15 14:52:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557763080 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:52:45.549938 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:45.550447 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:45.556946 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:45.557391 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:45.558304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:45.558746 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:45.729989 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] HTTP exception thrown: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Request method failure captured: Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d HTTP/1.1 Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_xFdwFsqv3FK89kRl4PykrTW20fdrlQjVV8tsSasc6cRQb2zMIKlvmcE_Oh2YddlKGogHNrn1Y9-eVMkJrJsxMGaW5eJTOzsy0dN2wNxnWOXY6TMxeNiIOHp7YhAfitIGoLf-a0-NUGlNTMHzqFOH6B4Vc-FSbhMxgeQvYecidDPw Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:52:45.731568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1efb0951ba1144d58698e02e0e5e9416 Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.733171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'ed0d4bf9-714b-4617-a166-8a8930710d3d'} Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:45.734365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.736260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.738361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Returning 404 to user: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:45.738361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8686776b-e157-43eb-865e-0e1f9f9c194f tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 404 len: 111 microversion: 2.1 time: 0.187650 Jun 15 14:52:45.738361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 417/855] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:52:45 2022] DELETE /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:45.744684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:45.745300 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: ed0d4bf9-714b-4617-a166-8a8930710d3d] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:45.752040 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:45.752511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:45.753275 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:45.753706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:45.767854 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] HTTP exception thrown: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Request method failure captured: Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d HTTP/1.1 Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_xFdwFsqv3FK89kRl4PykrTW20fdrlQjVV8tsSasc6cRQb2zMIKlvmcE_Oh2YddlKGogHNrn1Y9-eVMkJrJsxMGaW5eJTOzsy0dN2wNxnWOXY6TMxeNiIOHp7YhAfitIGoLf-a0-NUGlNTMHzqFOH6B4Vc-FSbhMxgeQvYecidDPw Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:52:45.769505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1efb0951ba1144d58698e02e0e5e9416 Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.771110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': 'ed0d4bf9-714b-4617-a166-8a8930710d3d'} Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:45.771946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. Jun 15 14:52:45.773144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:45.774335 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Returning 404 to user: Instance ed0d4bf9-714b-4617-a166-8a8930710d3d could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:45.774335 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a1c02ca0-4a7f-425b-b95d-82b098897259 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d" status: 404 len: 111 microversion: 2.1 time: 0.031012 Jun 15 14:52:45.774335 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 439/856] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:45 2022] GET /compute/v2.1/servers/ed0d4bf9-714b-4617-a166-8a8930710d3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:46.906318 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:46.906839 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:46.914923 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:46.915398 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:46.916150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:46.916577 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:46.930120 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] HTTP exception thrown: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Request method failure captured: Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c HTTP/1.1 Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_xFdwFsqv3FK89kRl4PykrTW20fdrlQjVV8tsSasc6cRQb2zMIKlvmcE_Oh2YddlKGogHNrn1Y9-eVMkJrJsxMGaW5eJTOzsy0dN2wNxnWOXY6TMxeNiIOHp7YhAfitIGoLf-a0-NUGlNTMHzqFOH6B4Vc-FSbhMxgeQvYecidDPw Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:52:46.931707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1efb0951ba1144d58698e02e0e5e9416 Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.933223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '992c4ee6-083c-4194-adff-7bf50b93e91c'} Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:46.934108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.935578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.937008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Returning 404 to user: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:46.937008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c9cf43d6-e057-4e39-bf2f-6b41d41a5b13 tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "DELETE /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 404 len: 111 microversion: 2.1 time: 0.030570 Jun 15 14:52:46.937008 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 418/857] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:52:46 2022] DELETE /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:46.941520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:46.942133 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] [instance: 992c4ee6-083c-4194-adff-7bf50b93e91c] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:46.948728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:46.949179 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:46.949937 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:46.950374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:46.965917 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] HTTP exception thrown: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Request method failure captured: Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c HTTP/1.1 Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_xFdwFsqv3FK89kRl4PykrTW20fdrlQjVV8tsSasc6cRQb2zMIKlvmcE_Oh2YddlKGogHNrn1Y9-eVMkJrJsxMGaW5eJTOzsy0dN2wNxnWOXY6TMxeNiIOHp7YhAfitIGoLf-a0-NUGlNTMHzqFOH6B4Vc-FSbhMxgeQvYecidDPw Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:52:46.967600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3ce7cecd2f4983b8442f70ed2afdb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 6d3ce7cecd2f4983b8442f70ed2afdb1 Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1288012967 Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1efb0951ba1144d58698e02e0e5e9416 Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeTestJSON-1288012967-project Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.969156 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '992c4ee6-083c-4194-adff-7bf50b93e91c'} Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:46.969983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. Jun 15 14:52:46.971671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:52:46.972760 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] Returning 404 to user: Instance 992c4ee6-083c-4194-adff-7bf50b93e91c could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:46.972760 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8e906e3b-905d-49ac-9485-36c8a1d7c54d tempest-AttachVolumeTestJSON-1288012967 tempest-AttachVolumeTestJSON-1288012967-project] 10.222.0.45 "GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c" status: 404 len: 111 microversion: 2.1 time: 0.031312 Jun 15 14:52:46.972760 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 440/858] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:46 2022] GET /compute/v2.1/servers/992c4ee6-083c-4194-adff-7bf50b93e91c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:50.339033 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:52:50.340062 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 14:52:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:53:19.619354 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bd4b038a-08c4-45b0-90a5-bb3c9d789a24 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9991bdab-1147-4b4e-8408-7b87393be47f", "device": "/dev/sdb"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:19.620951 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bd4b038a-08c4-45b0-90a5-bb3c9d789a24 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:19.623369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=42 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:19.623999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=26 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:19.630081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bd4b038a-08c4-45b0-90a5-bb3c9d789a24 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:19.631193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bd4b038a-08c4-45b0-90a5-bb3c9d789a24 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:19.631956 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bd4b038a-08c4-45b0-90a5-bb3c9d789a24 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:19.632382 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bd4b038a-08c4-45b0-90a5-bb3c9d789a24 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:22.829424 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bd4b038a-08c4-45b0-90a5-bb3c9d789a24 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "POST /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.214382 Jun 15 14:53:22.830091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 419/859] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:53:19 2022] POST /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48/os-volume_attachments => generated 194 bytes in 3216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:53.741978 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:53.742772 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=19 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:53.747379 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c9d050f4-7f58-489b-b057-dd744572d1c6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:53.747872 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c9d050f4-7f58-489b-b057-dd744572d1c6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:53.755180 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c9d050f4-7f58-489b-b057-dd744572d1c6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:53.755628 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c9d050f4-7f58-489b-b057-dd744572d1c6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:53.756396 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c9d050f4-7f58-489b-b057-dd744572d1c6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:53.756823 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c9d050f4-7f58-489b-b057-dd744572d1c6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:54.004905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-c9d050f4-7f58-489b-b057-dd744572d1c6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lazy-loading 'services' on Instance uuid 1bf2056c-e005-4212-aaaa-db59d3c77f48 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:53:54.079624 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c9d050f4-7f58-489b-b057-dd744572d1c6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48/os-volume_attachments/9991bdab-1147-4b4e-8408-7b87393be47f" status: 202 len: 0 microversion: 2.1 time: 0.339222 Jun 15 14:53:54.080515 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 441/860] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 14:53:53 2022] DELETE /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48/os-volume_attachments/9991bdab-1147-4b4e-8408-7b87393be47f => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:53:55.208421 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:55.209231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:55.214701 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3135d9f7-e4b6-4818-831b-4047cafe99d0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:55.215391 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3135d9f7-e4b6-4818-831b-4047cafe99d0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:55.224150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3135d9f7-e4b6-4818-831b-4047cafe99d0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:55.224975 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3135d9f7-e4b6-4818-831b-4047cafe99d0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:55.225923 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3135d9f7-e4b6-4818-831b-4047cafe99d0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:55.226515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3135d9f7-e4b6-4818-831b-4047cafe99d0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:55.254715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3135d9f7-e4b6-4818-831b-4047cafe99d0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:53:55.335699 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3135d9f7-e4b6-4818-831b-4047cafe99d0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 204 len: 0 microversion: 2.1 time: 0.128427 Jun 15 14:53:55.336364 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 420/861] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:53:55 2022] DELETE /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:53:55.347122 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ddc4b405-fceb-40eb-8bdb-7a0d9384d48a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:55.347822 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ddc4b405-fceb-40eb-8bdb-7a0d9384d48a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:55.354725 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ddc4b405-fceb-40eb-8bdb-7a0d9384d48a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:55.355271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ddc4b405-fceb-40eb-8bdb-7a0d9384d48a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:55.356104 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ddc4b405-fceb-40eb-8bdb-7a0d9384d48a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:55.356605 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ddc4b405-fceb-40eb-8bdb-7a0d9384d48a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:55.493962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ddc4b405-fceb-40eb-8bdb-7a0d9384d48a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:55.501673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ddc4b405-fceb-40eb-8bdb-7a0d9384d48a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1513 microversion: 2.1 time: 0.159753 Jun 15 14:53:55.502321 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 442/862] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:55 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:56.519865 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-31e2f83b-8a6f-42d6-a6ee-58c3c9892a46 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:56.520632 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-31e2f83b-8a6f-42d6-a6ee-58c3c9892a46 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:56.527057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31e2f83b-8a6f-42d6-a6ee-58c3c9892a46 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:56.527504 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31e2f83b-8a6f-42d6-a6ee-58c3c9892a46 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:56.528348 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31e2f83b-8a6f-42d6-a6ee-58c3c9892a46 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:56.528783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31e2f83b-8a6f-42d6-a6ee-58c3c9892a46 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:56.666662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-31e2f83b-8a6f-42d6-a6ee-58c3c9892a46 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:56.674283 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-31e2f83b-8a6f-42d6-a6ee-58c3c9892a46 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1513 microversion: 2.1 time: 0.158761 Jun 15 14:53:56.684365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 421/863] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:56 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:57.692034 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4662f938-c4eb-45d3-9fa5-b41828110b5d tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:57.692646 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4662f938-c4eb-45d3-9fa5-b41828110b5d tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:57.699780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4662f938-c4eb-45d3-9fa5-b41828110b5d tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:57.700236 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4662f938-c4eb-45d3-9fa5-b41828110b5d tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:57.700987 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4662f938-c4eb-45d3-9fa5-b41828110b5d tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:57.701426 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4662f938-c4eb-45d3-9fa5-b41828110b5d tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:57.828645 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4662f938-c4eb-45d3-9fa5-b41828110b5d tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:57.836088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4662f938-c4eb-45d3-9fa5-b41828110b5d tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 200 len: 1513 microversion: 2.1 time: 0.147920 Jun 15 14:53:57.836662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 443/864] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:57 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:58.205915 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-0b514db6-9448-43a3-a040-10e6a0778e29 req-f5002df9-c9ad-49f9-b541-665d8d8697a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf2056c-e005-4212-aaaa-db59d3c77f48", "name": "network-vif-deleted", "tag": "40c19e7c-4495-43ec-b690-60fe02d5ec44"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:58.216378 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-0b514db6-9448-43a3-a040-10e6a0778e29 req-f5002df9-c9ad-49f9-b541-665d8d8697a7 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:58.216542 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-0b514db6-9448-43a3-a040-10e6a0778e29 req-f5002df9-c9ad-49f9-b541-665d8d8697a7 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:58.229027 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-0b514db6-9448-43a3-a040-10e6a0778e29 req-f5002df9-c9ad-49f9-b541-665d8d8697a7 service nova] Creating event network-vif-deleted:40c19e7c-4495-43ec-b690-60fe02d5ec44 for instance 1bf2056c-e005-4212-aaaa-db59d3c77f48 on hv-cinder-80382 Jun 15 14:53:58.234075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-0b514db6-9448-43a3-a040-10e6a0778e29 req-f5002df9-c9ad-49f9-b541-665d8d8697a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031798 Jun 15 14:53:58.239227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 422/865] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:58.852689 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:58.853309 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 1bf2056c-e005-4212-aaaa-db59d3c77f48] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:58.860028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:58.860490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:58.861275 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:58.861731 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:58.875870 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] HTTP exception thrown: Instance 1bf2056c-e005-4212-aaaa-db59d3c77f48 could not be found. Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Request method failure captured: Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 HTTP/1.1 Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfIqZb7vSGZsHRA_KLfcL4PBoH5BIhvyHjfdnwxRuTHPT-celHJxGtBx5owTO1uetpeTg_oVkm2Rs4j_rNrPgN8PsreW2uHILJM9eLDyrloI4CZ2VISa_0qOkBkXR7zO-llI87cEPHhuX_EE52gv6I54rnFwMXoiyDPgk2cyknSH85s Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 28dfd45278d84a798da8e77bf7e6bc9d Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-VolumesSnapshotTestJSON-930718195 Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:53:58.877738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/28dfd45278d84a798da8e77bf7e6bc9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_28dfd45278d84a798da8e77bf7e6bc9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/28dfd45278d84a798da8e77bf7e6bc9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/28dfd45278d84a798da8e77bf7e6bc9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-VolumesSnapshotTestJSON-930718195 Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 28dfd45278d84a798da8e77bf7e6bc9d Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-930718195 Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-VolumesSnapshotTestJSON-930718195-project Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 235cd365a5ab41cda9bffd0cee150617 Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-VolumesSnapshotTestJSON-930718195-project Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 1bf2056c-e005-4212-aaaa-db59d3c77f48 could not be found. Jun 15 14:53:58.879397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '1bf2056c-e005-4212-aaaa-db59d3c77f48'} Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf2056c-e005-4212-aaaa-db59d3c77f48 could not be found. Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:53:58.880328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf2056c-e005-4212-aaaa-db59d3c77f48 could not be found. Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf2056c-e005-4212-aaaa-db59d3c77f48 could not be found. Jun 15 14:53:58.881873 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:53:58.883268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Returning 404 to user: Instance 1bf2056c-e005-4212-aaaa-db59d3c77f48 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:53:58.883268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d612e48d-b5bb-4bf2-97b4-85cacf15f06e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48" status: 404 len: 111 microversion: 2.1 time: 0.030669 Jun 15 14:53:58.883268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 444/866] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:58 2022] GET /compute/v2.1/servers/1bf2056c-e005-4212-aaaa-db59d3c77f48 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:54:10.853323 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:10.854954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:10.859769 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-725158155", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "networks": [{"uuid": "159ca85e-e8a2-4554-b820-1789a23ee856"}]}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:10.927512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] validate_networks() for [('159ca85e-e8a2-4554-b820-1789a23ee856', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:54:11.520431 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:54:11.520893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:54:11.521371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:54:11.521954 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:54:11.522371 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:54:11.533651 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:11.534106 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:11.535552 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:11.535993 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:11.556578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Getting quotas for project 28dfd45278d84a798da8e77bf7e6bc9d. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:54:11.561862 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Getting quotas for user 235cd365a5ab41cda9bffd0cee150617 and project 28dfd45278d84a798da8e77bf7e6bc9d. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:54:11.574616 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:54:11.577035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:54:11.627645 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1939ba00-68a1-4ca7-94dc-32f898452d5a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776179 Jun 15 14:54:11.634705 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 423/867] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:54:11.640320 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b5d6e781-cd46-4ddb-87fc-e7a53a81e7a6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:11.640976 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b5d6e781-cd46-4ddb-87fc-e7a53a81e7a6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:11.643498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=8 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:11.645840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:11.775155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b5d6e781-cd46-4ddb-87fc-e7a53a81e7a6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:11.782778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b5d6e781-cd46-4ddb-87fc-e7a53a81e7a6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1218 microversion: 2.1 time: 0.146935 Jun 15 14:54:11.783402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 445/868] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:11 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:12.800073 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bed7f9ff-2dbf-414d-8ac2-0890c37f0a8e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:12.801558 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bed7f9ff-2dbf-414d-8ac2-0890c37f0a8e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:12.821854 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bed7f9ff-2dbf-414d-8ac2-0890c37f0a8e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:12.823600 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bed7f9ff-2dbf-414d-8ac2-0890c37f0a8e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:12.824872 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bed7f9ff-2dbf-414d-8ac2-0890c37f0a8e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:12.825473 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bed7f9ff-2dbf-414d-8ac2-0890c37f0a8e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:12.902163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bed7f9ff-2dbf-414d-8ac2-0890c37f0a8e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:12.909712 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bed7f9ff-2dbf-414d-8ac2-0890c37f0a8e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1270 microversion: 2.1 time: 0.113628 Jun 15 14:54:12.910632 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 424/869] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:12 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:13.929499 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7ac2ac97-e22d-480e-822e-fc86c33a336e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:13.931494 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7ac2ac97-e22d-480e-822e-fc86c33a336e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:13.942322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7ac2ac97-e22d-480e-822e-fc86c33a336e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:13.943041 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7ac2ac97-e22d-480e-822e-fc86c33a336e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:13.944288 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7ac2ac97-e22d-480e-822e-fc86c33a336e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:13.944953 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7ac2ac97-e22d-480e-822e-fc86c33a336e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:14.395538 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7ac2ac97-e22d-480e-822e-fc86c33a336e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:14.422625 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7ac2ac97-e22d-480e-822e-fc86c33a336e tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1318 microversion: 2.1 time: 0.495260 Jun 15 14:54:14.427933 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 446/870] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:13 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:14.705775 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-cc7d9952-4872-4fb5-8f71-30ed484026d6 req-b1b5aeae-31bd-4e44-ae2a-a3c8fb37ea57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "702c61e0-a944-4e8b-ba18-460bd58ecb9b", "tag": "621f1776-b347-4940-8693-bf85609cbb8b"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:14.722659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-cc7d9952-4872-4fb5-8f71-30ed484026d6 req-b1b5aeae-31bd-4e44-ae2a-a3c8fb37ea57 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:14.726129 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-cc7d9952-4872-4fb5-8f71-30ed484026d6 req-b1b5aeae-31bd-4e44-ae2a-a3c8fb37ea57 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:14.748342 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-cc7d9952-4872-4fb5-8f71-30ed484026d6 req-b1b5aeae-31bd-4e44-ae2a-a3c8fb37ea57 service nova] Creating event network-changed:621f1776-b347-4940-8693-bf85609cbb8b for instance 702c61e0-a944-4e8b-ba18-460bd58ecb9b on hv-cinder-80382 Jun 15 14:54:14.757280 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-cc7d9952-4872-4fb5-8f71-30ed484026d6 req-b1b5aeae-31bd-4e44-ae2a-a3c8fb37ea57 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055399 Jun 15 14:54:14.761214 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 425/871] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:15.450534 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-bbeb538b-c21d-4f97-b6ce-d7e7a4a06489 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:15.451722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bbeb538b-c21d-4f97-b6ce-d7e7a4a06489 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:15.471039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bbeb538b-c21d-4f97-b6ce-d7e7a4a06489 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:15.472154 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bbeb538b-c21d-4f97-b6ce-d7e7a4a06489 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:15.476388 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bbeb538b-c21d-4f97-b6ce-d7e7a4a06489 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:15.477057 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bbeb538b-c21d-4f97-b6ce-d7e7a4a06489 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:16.120198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bbeb538b-c21d-4f97-b6ce-d7e7a4a06489 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:16.133171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-bbeb538b-c21d-4f97-b6ce-d7e7a4a06489 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1318 microversion: 2.1 time: 0.688695 Jun 15 14:54:16.133807 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 447/872] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:15 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1318 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:17.151711 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ff33a9f4-f0ed-4f16-a24e-afffc64defc3 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:17.152523 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ff33a9f4-f0ed-4f16-a24e-afffc64defc3 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:17.160955 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ff33a9f4-f0ed-4f16-a24e-afffc64defc3 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:17.161459 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ff33a9f4-f0ed-4f16-a24e-afffc64defc3 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:17.162349 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ff33a9f4-f0ed-4f16-a24e-afffc64defc3 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:17.162905 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ff33a9f4-f0ed-4f16-a24e-afffc64defc3 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:17.368990 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ff33a9f4-f0ed-4f16-a24e-afffc64defc3 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:17.378367 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ff33a9f4-f0ed-4f16-a24e-afffc64defc3 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1318 microversion: 2.1 time: 0.232374 Jun 15 14:54:17.388846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 426/873] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:17 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:18.395908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e53d5c40-88db-4517-9e04-25fa5ad69ad1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:18.402269 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e53d5c40-88db-4517-9e04-25fa5ad69ad1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:18.417891 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e53d5c40-88db-4517-9e04-25fa5ad69ad1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:18.418720 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e53d5c40-88db-4517-9e04-25fa5ad69ad1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:18.419665 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e53d5c40-88db-4517-9e04-25fa5ad69ad1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:18.420207 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e53d5c40-88db-4517-9e04-25fa5ad69ad1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:18.579324 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e53d5c40-88db-4517-9e04-25fa5ad69ad1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:18.586979 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e53d5c40-88db-4517-9e04-25fa5ad69ad1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1318 microversion: 2.1 time: 0.194863 Jun 15 14:54:18.587569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 448/874] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:18 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:18.609765 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4e616520-d43e-4834-b10c-5350d7a32cdc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Action: 'create', calling method: .version_select at 0x7f05bd611280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-35110241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH87D6CSV2s8LvUAkGYjsyHQLM3YFCJENyoo+xm52iZjdT4U7pCR4Qw3FG2Qi3way9tU9i2cbvp5I0IG9pGHmIvjElDBWafyzUkZJ3QdMk23DmQaOwrSUoICLtq9uhLLDQ=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:18.625710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-4e616520-d43e-4834-b10c-5350d7a32cdc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Getting quotas for project 59120b6715c1485db0cb1277a52e6c55. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:54:18.629639 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-4e616520-d43e-4834-b10c-5350d7a32cdc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Getting quotas for user 1b23fa0b7fdb4016917987ea1c40af33 and project 59120b6715c1485db0cb1277a52e6c55. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:54:18.642421 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4e616520-d43e-4834-b10c-5350d7a32cdc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [65302e8f-767f-4149-8b3c-915c34acd578] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 14:54:19.604186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3cd9097f-b005-4317-85d2-65f6b0d7b480 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:19.604793 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3cd9097f-b005-4317-85d2-65f6b0d7b480 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:19.612053 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3cd9097f-b005-4317-85d2-65f6b0d7b480 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:19.612613 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3cd9097f-b005-4317-85d2-65f6b0d7b480 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:19.613697 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3cd9097f-b005-4317-85d2-65f6b0d7b480 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:19.614239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3cd9097f-b005-4317-85d2-65f6b0d7b480 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:19.650903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [None req-4e616520-d43e-4834-b10c-5350d7a32cdc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [65302e8f-767f-4149-8b3c-915c34acd578] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 55168. Jun 15 14:54:19.668465 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4e616520-d43e-4834-b10c-5350d7a32cdc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.262498 Jun 15 14:54:19.669127 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 427/875] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 14:54:18 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:54:19.765077 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3cd9097f-b005-4317-85d2-65f6b0d7b480 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:19.774857 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3cd9097f-b005-4317-85d2-65f6b0d7b480 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1318 microversion: 2.1 time: 0.174589 Jun 15 14:54:19.783058 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 449/876] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:19 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:20.792434 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e5f5a561-8a20-4f4a-8d50-a2f590ff27b1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:20.793162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e5f5a561-8a20-4f4a-8d50-a2f590ff27b1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:20.800661 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5f5a561-8a20-4f4a-8d50-a2f590ff27b1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:20.801113 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5f5a561-8a20-4f4a-8d50-a2f590ff27b1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:20.801884 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5f5a561-8a20-4f4a-8d50-a2f590ff27b1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:20.802522 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5f5a561-8a20-4f4a-8d50-a2f590ff27b1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:20.936236 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e5f5a561-8a20-4f4a-8d50-a2f590ff27b1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:20.945707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e5f5a561-8a20-4f4a-8d50-a2f590ff27b1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1318 microversion: 2.1 time: 0.157480 Jun 15 14:54:20.948066 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 428/877] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:20 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:21.468491 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-5bba8b0f-853c-4ef4-bb13-bcd621e931e6 req-575b82e7-160d-4e05-bd58-6093720a6912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702c61e0-a944-4e8b-ba18-460bd58ecb9b", "name": "network-vif-plugged", "status": "completed", "tag": "621f1776-b347-4940-8693-bf85609cbb8b"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:21.478072 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-5bba8b0f-853c-4ef4-bb13-bcd621e931e6 req-575b82e7-160d-4e05-bd58-6093720a6912 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:21.478427 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-5bba8b0f-853c-4ef4-bb13-bcd621e931e6 req-575b82e7-160d-4e05-bd58-6093720a6912 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:21.508864 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-5bba8b0f-853c-4ef4-bb13-bcd621e931e6 req-575b82e7-160d-4e05-bd58-6093720a6912 service nova] Creating event network-vif-plugged:621f1776-b347-4940-8693-bf85609cbb8b for instance 702c61e0-a944-4e8b-ba18-460bd58ecb9b on hv-cinder-80382 Jun 15 14:54:21.525055 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-5bba8b0f-853c-4ef4-bb13-bcd621e931e6 req-575b82e7-160d-4e05-bd58-6093720a6912 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060208 Jun 15 14:54:21.531106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 450/878] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:21.965756 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a7986f94-7f16-4a30-bad0-ec038b5320e5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:21.971527 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a7986f94-7f16-4a30-bad0-ec038b5320e5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:21.975313 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:21.980685 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7986f94-7f16-4a30-bad0-ec038b5320e5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:21.981146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7986f94-7f16-4a30-bad0-ec038b5320e5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:21.981941 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7986f94-7f16-4a30-bad0-ec038b5320e5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:21.982378 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7986f94-7f16-4a30-bad0-ec038b5320e5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:22.142126 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a7986f94-7f16-4a30-bad0-ec038b5320e5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:22.155393 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a7986f94-7f16-4a30-bad0-ec038b5320e5 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1318 microversion: 2.1 time: 0.194285 Jun 15 14:54:22.155980 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 429/879] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:21 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:23.173306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9d2361ab-6ee8-4b20-ba6a-62b17076910f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:23.174146 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9d2361ab-6ee8-4b20-ba6a-62b17076910f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:23.176733 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:23.185025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d2361ab-6ee8-4b20-ba6a-62b17076910f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:23.185479 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d2361ab-6ee8-4b20-ba6a-62b17076910f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:23.186497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d2361ab-6ee8-4b20-ba6a-62b17076910f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:23.186974 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9d2361ab-6ee8-4b20-ba6a-62b17076910f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:23.317617 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9d2361ab-6ee8-4b20-ba6a-62b17076910f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:23.325518 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9d2361ab-6ee8-4b20-ba6a-62b17076910f tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1318 microversion: 2.1 time: 0.156898 Jun 15 14:54:23.326074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 451/880] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:23 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:24.343076 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-50cd36d8-4925-4871-934a-0b5d2e90b3b8 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:24.343682 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-50cd36d8-4925-4871-934a-0b5d2e90b3b8 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:24.350249 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50cd36d8-4925-4871-934a-0b5d2e90b3b8 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:24.350687 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50cd36d8-4925-4871-934a-0b5d2e90b3b8 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:24.351498 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50cd36d8-4925-4871-934a-0b5d2e90b3b8 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:24.351927 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50cd36d8-4925-4871-934a-0b5d2e90b3b8 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:24.487839 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-50cd36d8-4925-4871-934a-0b5d2e90b3b8 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:24.496007 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-50cd36d8-4925-4871-934a-0b5d2e90b3b8 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1506 microversion: 2.1 time: 0.156044 Jun 15 14:54:24.496568 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 430/881] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:24 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:24.512392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-baedf772-bb3b-40fc-ae83-bbe16b44ffc0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47b7596c-7be3-4fa0-8529-a120a243c786", "device": "/dev/sdb"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:24.513887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-baedf772-bb3b-40fc-ae83-bbe16b44ffc0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:24.520412 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-baedf772-bb3b-40fc-ae83-bbe16b44ffc0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:24.520865 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-baedf772-bb3b-40fc-ae83-bbe16b44ffc0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:24.521627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-baedf772-bb3b-40fc-ae83-bbe16b44ffc0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:24.522066 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-baedf772-bb3b-40fc-ae83-bbe16b44ffc0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:24.797393 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-baedf772-bb3b-40fc-ae83-bbe16b44ffc0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "POST /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288292 Jun 15 14:54:24.798148 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 452/882] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:54:24 2022] POST /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:40.383911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bf6a0b04-e17d-4cec-95d9-3ba6b43240ed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:40.384977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bf6a0b04-e17d-4cec-95d9-3ba6b43240ed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:40.387010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=10 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:40.387738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:40.388529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=34 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:40.395359 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf6a0b04-e17d-4cec-95d9-3ba6b43240ed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:40.395807 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf6a0b04-e17d-4cec-95d9-3ba6b43240ed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:40.396565 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf6a0b04-e17d-4cec-95d9-3ba6b43240ed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:40.396996 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf6a0b04-e17d-4cec-95d9-3ba6b43240ed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:40.429444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bf6a0b04-e17d-4cec-95d9-3ba6b43240ed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049618 Jun 15 14:54:40.429974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 431/883] 10.222.0.45 () {60 vars in 1342 bytes} [Wed Jun 15 14:54:40 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:40.485818 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fdcbf9d0-ebc1-4996-a129-6b58a8c7c9c8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:40.486310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fdcbf9d0-ebc1-4996-a129-6b58a8c7c9c8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:40.488867 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=18 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:40.489530 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:40.495630 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fdcbf9d0-ebc1-4996-a129-6b58a8c7c9c8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:40.496079 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fdcbf9d0-ebc1-4996-a129-6b58a8c7c9c8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:40.496831 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fdcbf9d0-ebc1-4996-a129-6b58a8c7c9c8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:40.497264 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fdcbf9d0-ebc1-4996-a129-6b58a8c7c9c8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:40.523869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fdcbf9d0-ebc1-4996-a129-6b58a8c7c9c8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:54:40.599534 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fdcbf9d0-ebc1-4996-a129-6b58a8c7c9c8 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 204 len: 0 microversion: 2.20 time: 0.117586 Jun 15 14:54:40.600298 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 453/884] 10.222.0.45 () {60 vars in 1279 bytes} [Wed Jun 15 14:54:40 2022] DELETE /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 14:54:40.609868 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:40.611704 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:40.618601 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:40.619088 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:40.619866 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:40.620304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:40.747982 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:40.756015 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:40.757533 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:40.758724 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8ab13bdc-67cb-4bc8-a815-c9ba469f4488 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.153730 Jun 15 14:54:40.759811 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 432/885] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:40 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:54:41.777269 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:41.778095 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:41.784629 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:41.785099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:41.785859 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:41.786312 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:41.918202 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:41.926061 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:41.927614 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:41.929224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f8f772fb-e78c-4bfd-80fb-2d2f98565bed tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.156309 Jun 15 14:54:41.929812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 454/886] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:41 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:54:42.947663 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:42.948261 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:42.954621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:42.955095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:42.955853 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:42.956284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:43.084334 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:43.092211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:43.093719 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:43.094869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-68d231c1-e8f6-474b-8ae1-a4f0fd90a65d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.151049 Jun 15 14:54:43.095427 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 433/887] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:42 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:54:44.113617 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:44.114224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:44.121877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:44.122348 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:44.123145 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:44.123586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:44.253265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:44.261725 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:44.263262 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:44.264421 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-40b92ac6-f452-43f2-b532-fc95b307547d tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.154818 Jun 15 14:54:44.264968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 455/888] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:44 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:54:45.282440 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:45.283075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:45.289726 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:45.290183 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:45.290937 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:45.291401 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:45.419403 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:45.427222 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:45.428736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:45.429885 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4a9288e9-1370-499f-ab7e-97b12cf542e3 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.151306 Jun 15 14:54:45.430433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 434/889] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:45 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:54:46.448644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:46.449259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:46.455662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:46.456117 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:46.456882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:46.457326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:46.589602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:46.597441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:46.598947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:46.600112 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9ec1f139-cd10-4b99-b12f-ffb8c0c2ff9c tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.156064 Jun 15 14:54:46.600669 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 456/890] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:46 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:54:47.617795 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:47.618405 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:47.625535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.625991 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.626763 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.627245 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.758286 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:47.766442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:47.767983 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:47.769138 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8293d410-54af-4610-b456-4f342ba4f9bf tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1722 microversion: 2.20 time: 0.155400 Jun 15 14:54:47.769681 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 435/891] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:47 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:54:48.416767 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-e2131079-955a-453f-ae0b-ba3e2e6c684f req-4a2e3af3-6dbb-4472-b735-7fe48b1eb893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00a072c-e13e-4b90-b5f4-7341aea301b7", "name": "network-vif-deleted", "tag": "5b328c6b-5677-47c6-b09a-974f22b96d56"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:48.418350 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-e2131079-955a-453f-ae0b-ba3e2e6c684f req-4a2e3af3-6dbb-4472-b735-7fe48b1eb893 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:48.419373 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-e2131079-955a-453f-ae0b-ba3e2e6c684f req-4a2e3af3-6dbb-4472-b735-7fe48b1eb893 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:48.430760 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-e2131079-955a-453f-ae0b-ba3e2e6c684f req-4a2e3af3-6dbb-4472-b735-7fe48b1eb893 service nova] Creating event network-vif-deleted:5b328c6b-5677-47c6-b09a-974f22b96d56 for instance c00a072c-e13e-4b90-b5f4-7341aea301b7 on hv-cinder-80382 Jun 15 14:54:48.437549 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-e2131079-955a-453f-ae0b-ba3e2e6c684f req-4a2e3af3-6dbb-4472-b735-7fe48b1eb893 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195558 Jun 15 14:54:48.438336 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 457/892] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:48.788093 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:48.788983 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:48.796168 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:48.796628 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:48.797410 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:48.797892 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:48.829446 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:48.829903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:48.830361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lazy-loading 'fault' on Instance uuid c00a072c-e13e-4b90-b5f4-7341aea301b7 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:48.873928 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:48.882899 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:48.884935 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25ba370b8daf49e48514cd49c2851215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d57ba7dd0d441b9748fc600bc34972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:48.886937 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a086a1ca-ee4e-4aed-af99-f3c842af7ef2 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 200 len: 1370 microversion: 2.20 time: 0.102435 Jun 15 14:54:48.887180 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 436/893] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:48 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:54:49.906137 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:49.906829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:49.913033 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.913738 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:49.914491 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.914926 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:49.928408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] HTTP exception thrown: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Request method failure captured: Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 HTTP/1.1 Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_zZixbaRFUMdtfNlKZN_4qoJiGm4dkZ9oau08zguSrgmDsRFiXZTcbu2F5rf_s1w447PoJDiX4fszRLyiqv1PJkTC4by-pl-XkJSzRuUo9L4-t3jCq1aFOb0GckSxDj5Z6pLmxjY8X61MfcvcQB31lqoO_OojxKrQ--Ra2K8KllAs Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:54:49.930010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 25ba370b8daf49e48514cd49c2851215 Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:49.931816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': 'c00a072c-e13e-4b90-b5f4-7341aea301b7'} Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:49.932757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:49.934342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:49.935785 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Returning 404 to user: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:49.935785 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cdf41d33-16df-4a19-a3e8-0ff2c2ad7852 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 404 len: 111 microversion: 2.20 time: 0.030013 Jun 15 14:54:49.935785 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 458/894] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:49 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:54:49.940126 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-795a3641-b6f2-4bba-a3a7-3fb5d139a494 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '.version_select at 0x7f05b75c7b80>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:49.957827 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-795a3641-b6f2-4bba-a3a7-3fb5d139a494 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92655115" status: 204 len: 0 microversion: 2.20 time: 0.021405 Jun 15 14:54:49.958365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 437/895] 10.222.0.45 () {60 vars in 1255 bytes} [Wed Jun 15 14:54:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92655115 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 14:54:51.320552 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c660b703-e312-4bd8-9a05-799c0e730d4a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:51.321033 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c660b703-e312-4bd8-9a05-799c0e730d4a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:51.327630 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c660b703-e312-4bd8-9a05-799c0e730d4a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.328085 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c660b703-e312-4bd8-9a05-799c0e730d4a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.328846 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c660b703-e312-4bd8-9a05-799c0e730d4a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.329286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c660b703-e312-4bd8-9a05-799c0e730d4a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.407834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-c660b703-e312-4bd8-9a05-799c0e730d4a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lazy-loading 'services' on Instance uuid 702c61e0-a944-4e8b-ba18-460bd58ecb9b {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:51.483832 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c660b703-e312-4bd8-9a05-799c0e730d4a tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "DELETE /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b/os-volume_attachments/47b7596c-7be3-4fa0-8529-a120a243c786" status: 202 len: 0 microversion: 2.1 time: 0.167010 Jun 15 14:54:51.484468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 459/896] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 14:54:51 2022] DELETE /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b/os-volume_attachments/47b7596c-7be3-4fa0-8529-a120a243c786 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:54:51.703586 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:51.704175 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:51.711670 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.712125 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.713414 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.713857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.726831 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] HTTP exception thrown: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Request method failure captured: Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 HTTP/1.1 Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_zZixbaRFUMdtfNlKZN_4qoJiGm4dkZ9oau08zguSrgmDsRFiXZTcbu2F5rf_s1w447PoJDiX4fszRLyiqv1PJkTC4by-pl-XkJSzRuUo9L4-t3jCq1aFOb0GckSxDj5Z6pLmxjY8X61MfcvcQB31lqoO_OojxKrQ--Ra2K8KllAs Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:54:51.729289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 25ba370b8daf49e48514cd49c2851215 Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.730985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'c00a072c-e13e-4b90-b5f4-7341aea301b7'} Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:51.731790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.733016 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.734889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Returning 404 to user: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:51.734889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-94312a07-3c0d-4c19-9f89-17927f934137 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 404 len: 111 microversion: 2.20 time: 0.030929 Jun 15 14:54:51.734889 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 438/897] 10.222.0.45 () {60 vars in 1279 bytes} [Wed Jun 15 14:54:51 2022] DELETE /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:54:51.739510 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:51.740200 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: c00a072c-e13e-4b90-b5f4-7341aea301b7] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:51.746903 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.747378 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.748130 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.748564 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.762244 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] HTTP exception thrown: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Request method failure captured: Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 HTTP/1.1 Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_zZixbaRFUMdtfNlKZN_4qoJiGm4dkZ9oau08zguSrgmDsRFiXZTcbu2F5rf_s1w447PoJDiX4fszRLyiqv1PJkTC4by-pl-XkJSzRuUo9L4-t3jCq1aFOb0GckSxDj5Z6pLmxjY8X61MfcvcQB31lqoO_OojxKrQ--Ra2K8KllAs Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:54:51.763869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 25ba370b8daf49e48514cd49c2851215 Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.765497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': 'c00a072c-e13e-4b90-b5f4-7341aea301b7'} Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:51.766277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. Jun 15 14:54:51.767511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.768908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Returning 404 to user: Instance c00a072c-e13e-4b90-b5f4-7341aea301b7 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:51.768908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-188d9b6b-7237-474a-9529-054cb4496ea5 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7" status: 404 len: 111 microversion: 2.20 time: 0.029966 Jun 15 14:54:51.768908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 460/898] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:51 2022] GET /compute/v2.1/servers/c00a072c-e13e-4b90-b5f4-7341aea301b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:54:52.897156 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:52.897672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:52.904742 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.905189 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.905953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.906389 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.921427 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] HTTP exception thrown: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Request method failure captured: Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 HTTP/1.1 Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqe_zZixbaRFUMdtfNlKZN_4qoJiGm4dkZ9oau08zguSrgmDsRFiXZTcbu2F5rf_s1w447PoJDiX4fszRLyiqv1PJkTC4by-pl-XkJSzRuUo9L4-t3jCq1aFOb0GckSxDj5Z6pLmxjY8X61MfcvcQB31lqoO_OojxKrQ--Ra2K8KllAs Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:54:52.922974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 25ba370b8daf49e48514cd49c2851215 Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.924618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '75215a3c-bc0f-4e8b-9c52-a35946a5bfb1'} Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:52.925511 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.927057 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.928804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Returning 404 to user: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:52.928804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2d780626-ee7d-4006-9632-0d86ee0857e0 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 404 len: 111 microversion: 2.20 time: 0.031173 Jun 15 14:54:52.928804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 439/899] 10.222.0.45 () {60 vars in 1279 bytes} [Wed Jun 15 14:54:52 2022] DELETE /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:54:52.933290 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:52.933901 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] [instance: 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:52.940499 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.940954 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.941711 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.942170 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.956005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] HTTP exception thrown: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Request method failure captured: Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 HTTP/1.1 Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqe_zZixbaRFUMdtfNlKZN_4qoJiGm4dkZ9oau08zguSrgmDsRFiXZTcbu2F5rf_s1w447PoJDiX4fszRLyiqv1PJkTC4by-pl-XkJSzRuUo9L4-t3jCq1aFOb0GckSxDj5Z6pLmxjY8X61MfcvcQB31lqoO_OojxKrQ--Ra2K8KllAs Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:54:52.957548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/54d57ba7dd0d441b9748fc600bc34972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 54d57ba7dd0d441b9748fc600bc34972 Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236317922 Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 25ba370b8daf49e48514cd49c2851215 Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236317922-project Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.959249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '75215a3c-bc0f-4e8b-9c52-a35946a5bfb1'} Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:52.963387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. Jun 15 14:54:52.965279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:52.966614 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] Returning 404 to user: Instance 75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:52.966614 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-de9a3e11-2e52-469a-ba24-dcebccebb983 tempest-AttachVolumeShelveTestJSON-236317922 tempest-AttachVolumeShelveTestJSON-236317922-project] 10.222.0.45 "GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1" status: 404 len: 111 microversion: 2.20 time: 0.030022 Jun 15 14:54:52.966614 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 461/900] 10.222.0.45 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:52 2022] GET /compute/v2.1/servers/75215a3c-bc0f-4e8b-9c52-a35946a5bfb1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:54:53.650696 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ab5adfa8-d28e-46bb-9292-7ba497af3352 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:53.651242 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ab5adfa8-d28e-46bb-9292-7ba497af3352 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:53.658351 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab5adfa8-d28e-46bb-9292-7ba497af3352 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.658804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab5adfa8-d28e-46bb-9292-7ba497af3352 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.659596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab5adfa8-d28e-46bb-9292-7ba497af3352 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.660067 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab5adfa8-d28e-46bb-9292-7ba497af3352 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.685854 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ab5adfa8-d28e-46bb-9292-7ba497af3352 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:54:53.769814 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ab5adfa8-d28e-46bb-9292-7ba497af3352 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "DELETE /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 204 len: 0 microversion: 2.1 time: 0.123163 Jun 15 14:54:53.770368 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 440/901] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:54:53 2022] DELETE /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:54:53.779434 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1f0f3e55-fb05-4ebb-b580-641bfbbff4b0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:53.780049 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1f0f3e55-fb05-4ebb-b580-641bfbbff4b0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:53.786075 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1f0f3e55-fb05-4ebb-b580-641bfbbff4b0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.786528 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1f0f3e55-fb05-4ebb-b580-641bfbbff4b0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.787316 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1f0f3e55-fb05-4ebb-b580-641bfbbff4b0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.787754 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1f0f3e55-fb05-4ebb-b580-641bfbbff4b0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.919221 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1f0f3e55-fb05-4ebb-b580-641bfbbff4b0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:53.926824 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1f0f3e55-fb05-4ebb-b580-641bfbbff4b0 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1512 microversion: 2.1 time: 0.151826 Jun 15 14:54:53.927417 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 462/902] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:53 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:54.945809 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2abd44b9-8bc1-40c9-94c7-eb38124a7bc6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:54.946512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2abd44b9-8bc1-40c9-94c7-eb38124a7bc6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:54.954617 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2abd44b9-8bc1-40c9-94c7-eb38124a7bc6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.955090 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2abd44b9-8bc1-40c9-94c7-eb38124a7bc6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:54.956165 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2abd44b9-8bc1-40c9-94c7-eb38124a7bc6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.957048 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2abd44b9-8bc1-40c9-94c7-eb38124a7bc6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.101594 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2abd44b9-8bc1-40c9-94c7-eb38124a7bc6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:55.113281 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2abd44b9-8bc1-40c9-94c7-eb38124a7bc6 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1512 microversion: 2.1 time: 0.172235 Jun 15 14:54:55.123596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 441/903] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:54 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:55.923829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1691380039", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-35110241", "security_groups": [{"name": "tempest-secgroup-smoke-1779386159"}], "block_device_mapping_v2": [{"uuid": "afe920ec-1358-497e-b614-f75778f555fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3df4bca9-703b-4106-bc35-604acde24861"}]}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:56.106897 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] validate_networks() for [('3df4bca9-703b-4106-bc35-604acde24861', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:54:56.133178 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2c4a746a-f89e-49c7-ac51-c031a6a22dea tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:56.135177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2c4a746a-f89e-49c7-ac51-c031a6a22dea tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:56.144913 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c4a746a-f89e-49c7-ac51-c031a6a22dea tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:56.146368 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c4a746a-f89e-49c7-ac51-c031a6a22dea tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.147455 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c4a746a-f89e-49c7-ac51-c031a6a22dea tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:56.148723 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c4a746a-f89e-49c7-ac51-c031a6a22dea tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.338840 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2c4a746a-f89e-49c7-ac51-c031a6a22dea tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:56.347299 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2c4a746a-f89e-49c7-ac51-c031a6a22dea tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1512 microversion: 2.1 time: 0.219652 Jun 15 14:54:56.348217 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 442/904] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:56 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:56.809771 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:54:56.810570 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:54:56.811412 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:54:56.812196 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:54:56.812944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:54:56.829245 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:56.829938 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.830969 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:56.831743 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.854244 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Getting quotas for project 59120b6715c1485db0cb1277a52e6c55. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:54:56.858524 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Getting quotas for user 1b23fa0b7fdb4016917987ea1c40af33 and project 59120b6715c1485db0cb1277a52e6c55. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:54:56.862007 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-8325b035-038c-4d8d-93c9-ae8a98618302 req-046081b8-128e-4ef1-b79a-8f815ddd51da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702c61e0-a944-4e8b-ba18-460bd58ecb9b", "name": "network-vif-deleted", "tag": "621f1776-b347-4940-8693-bf85609cbb8b"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:56.875571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8325b035-038c-4d8d-93c9-ae8a98618302 req-046081b8-128e-4ef1-b79a-8f815ddd51da service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:56.876119 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8325b035-038c-4d8d-93c9-ae8a98618302 req-046081b8-128e-4ef1-b79a-8f815ddd51da service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.894298 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-8325b035-038c-4d8d-93c9-ae8a98618302 req-046081b8-128e-4ef1-b79a-8f815ddd51da service nova] Creating event network-vif-deleted:621f1776-b347-4940-8693-bf85609cbb8b for instance 702c61e0-a944-4e8b-ba18-460bd58ecb9b on hv-cinder-80382 Jun 15 14:54:56.902218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-8325b035-038c-4d8d-93c9-ae8a98618302 req-046081b8-128e-4ef1-b79a-8f815ddd51da service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045635 Jun 15 14:54:56.902937 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 443/905] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:56.930784 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:54:56.933446 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afe920ec-1358-497e-b614-f75778f555fc',volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:54:57.079341 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2e75b5be-3f88-4a1f-9fe9-d4e4d81bd280 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.158854 Jun 15 14:54:57.080106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 463/906] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:54:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:54:57.090499 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cdc5405e-66e4-4a92-8938-c7de8adaed39 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:57.091530 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cdc5405e-66e4-4a92-8938-c7de8adaed39 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:57.149791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cdc5405e-66e4-4a92-8938-c7de8adaed39 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:57.156736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cdc5405e-66e4-4a92-8938-c7de8adaed39 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1093 microversion: 2.1 time: 0.070434 Jun 15 14:54:57.157404 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 444/907] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:57 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:57.366597 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:57.367328 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:57.387632 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.388458 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.389833 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.390294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.437492 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.438185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.438803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lazy-loading 'fault' on Instance uuid 702c61e0-a944-4e8b-ba18-460bd58ecb9b {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:57.488654 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235cd365a5ab41cda9bffd0cee150617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dfd45278d84a798da8e77bf7e6bc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:57.501113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-eed34f74-3f0d-4b1b-be8f-9623ac18dc3b tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 200 len: 1308 microversion: 2.1 time: 0.138604 Jun 15 14:54:57.502646 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 464/908] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:57 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:58.174227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b56b7cfa-6704-46b6-a8ec-802363ee8b32 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:58.175675 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b56b7cfa-6704-46b6-a8ec-802363ee8b32 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:58.182671 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b56b7cfa-6704-46b6-a8ec-802363ee8b32 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.183585 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b56b7cfa-6704-46b6-a8ec-802363ee8b32 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.184744 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b56b7cfa-6704-46b6-a8ec-802363ee8b32 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.185556 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b56b7cfa-6704-46b6-a8ec-802363ee8b32 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.251959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b56b7cfa-6704-46b6-a8ec-802363ee8b32 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:58.260224 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b56b7cfa-6704-46b6-a8ec-802363ee8b32 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1191 microversion: 2.1 time: 0.090219 Jun 15 14:54:58.261209 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 445/909] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:58 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:58.522801 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:58.524472 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] [instance: 702c61e0-a944-4e8b-ba18-460bd58ecb9b] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:58.537952 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.539097 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.540245 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.541993 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.561564 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] HTTP exception thrown: Instance 702c61e0-a944-4e8b-ba18-460bd58ecb9b could not be found. Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Request method failure captured: Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b HTTP/1.1 Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfIqZb7vSGZsHRA_KLfcL4PBoH5BIhvyHjfdnwxRuTHPT-celHJxGtBx5owTO1uetpeTg_oVkm2Rs4j_rNrPgN8PsreW2uHILJM9eLDyrloI4CZ2VISa_0qOkBkXR7zO-llI87cEPHhuX_EE52gv6I54rnFwMXoiyDPgk2cyknSH85s Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 28dfd45278d84a798da8e77bf7e6bc9d Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-VolumesSnapshotTestJSON-930718195 Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:54:58.563418 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/28dfd45278d84a798da8e77bf7e6bc9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_28dfd45278d84a798da8e77bf7e6bc9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/28dfd45278d84a798da8e77bf7e6bc9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/28dfd45278d84a798da8e77bf7e6bc9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-VolumesSnapshotTestJSON-930718195 Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 28dfd45278d84a798da8e77bf7e6bc9d Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-930718195 Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-VolumesSnapshotTestJSON-930718195-project Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 235cd365a5ab41cda9bffd0cee150617 Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-VolumesSnapshotTestJSON-930718195-project Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 702c61e0-a944-4e8b-ba18-460bd58ecb9b could not be found. Jun 15 14:54:58.565056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '702c61e0-a944-4e8b-ba18-460bd58ecb9b'} Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702c61e0-a944-4e8b-ba18-460bd58ecb9b could not be found. Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:58.565991 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702c61e0-a944-4e8b-ba18-460bd58ecb9b could not be found. Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702c61e0-a944-4e8b-ba18-460bd58ecb9b could not be found. Jun 15 14:54:58.567550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:54:58.569717 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] Returning 404 to user: Instance 702c61e0-a944-4e8b-ba18-460bd58ecb9b could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:58.570724 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-329d1b05-d341-4fbc-a1a0-358fc7004cb1 tempest-VolumesSnapshotTestJSON-930718195 tempest-VolumesSnapshotTestJSON-930718195-project] 10.222.0.45 "GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b" status: 404 len: 111 microversion: 2.1 time: 0.054532 Jun 15 14:54:58.571648 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 465/910] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:58 2022] GET /compute/v2.1/servers/702c61e0-a944-4e8b-ba18-460bd58ecb9b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:54:59.277327 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4e3e3068-93db-4833-b541-a78120094d8d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:59.278635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4e3e3068-93db-4833-b541-a78120094d8d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:59.288375 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e3e3068-93db-4833-b541-a78120094d8d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.289361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e3e3068-93db-4833-b541-a78120094d8d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.298514 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e3e3068-93db-4833-b541-a78120094d8d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.299455 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e3e3068-93db-4833-b541-a78120094d8d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.662175 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4e3e3068-93db-4833-b541-a78120094d8d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:59.671777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4e3e3068-93db-4833-b541-a78120094d8d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.398345 Jun 15 14:54:59.672903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 446/911] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:59 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:00.210937 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-495e0b7e-674c-4cf9-a9ce-843b4472a47c req-05734c02-5d7d-4c60-9d12-bd9628270097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c62c5ab-613d-4a52-95e0-7ffe043a9628", "tag": "62922aed-bb0a-4def-8adc-0a60c9968f87"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:00.247655 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-495e0b7e-674c-4cf9-a9ce-843b4472a47c req-05734c02-5d7d-4c60-9d12-bd9628270097 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.260205 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-495e0b7e-674c-4cf9-a9ce-843b4472a47c req-05734c02-5d7d-4c60-9d12-bd9628270097 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:00.303614 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-495e0b7e-674c-4cf9-a9ce-843b4472a47c req-05734c02-5d7d-4c60-9d12-bd9628270097 service nova] Creating event network-changed:62922aed-bb0a-4def-8adc-0a60c9968f87 for instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 on hv-cinder-80382 Jun 15 14:55:00.317676 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-495e0b7e-674c-4cf9-a9ce-843b4472a47c req-05734c02-5d7d-4c60-9d12-bd9628270097 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112966 Jun 15 14:55:00.324169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 466/912] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:00.693147 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e3af8f39-2a86-44e1-a538-22c181c58b75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:00.694674 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e3af8f39-2a86-44e1-a538-22c181c58b75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:00.720699 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3af8f39-2a86-44e1-a538-22c181c58b75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.721704 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3af8f39-2a86-44e1-a538-22c181c58b75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:00.723716 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3af8f39-2a86-44e1-a538-22c181c58b75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.724466 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3af8f39-2a86-44e1-a538-22c181c58b75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:01.019391 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e3af8f39-2a86-44e1-a538-22c181c58b75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:01.037761 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e3af8f39-2a86-44e1-a538-22c181c58b75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.351473 Jun 15 14:55:01.040104 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 447/913] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:00 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:02.058552 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-daa7756f-5d35-4b39-a53a-45fdbfcd11db tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:02.059713 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-daa7756f-5d35-4b39-a53a-45fdbfcd11db tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:02.073791 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-daa7756f-5d35-4b39-a53a-45fdbfcd11db tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:02.074830 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-daa7756f-5d35-4b39-a53a-45fdbfcd11db tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:02.076548 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-daa7756f-5d35-4b39-a53a-45fdbfcd11db tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:02.077256 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-daa7756f-5d35-4b39-a53a-45fdbfcd11db tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:02.324015 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-daa7756f-5d35-4b39-a53a-45fdbfcd11db tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:02.333129 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-daa7756f-5d35-4b39-a53a-45fdbfcd11db tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.280237 Jun 15 14:55:02.344027 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 467/914] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:02 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:03.253554 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-84068fc2-dac0-447b-b277-546321457f6a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: .version_select at 0x7f05b773a040>, body: {"keypair": {"name": "tempest-keypair-2101857716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4DSdz2Nj5iKrKnzP1KCcDGIWnXaNY8DrFVENGfZvj/agkseRzS28rpZUgdwaFpzycxOuKe+UeZ482Sv5KMASNwE+K8VOnxJUYgefQKhJ8qRGlbAMVF/qlc9zgkPB/zvQ=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:03.268077 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-84068fc2-dac0-447b-b277-546321457f6a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:55:03.271953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-84068fc2-dac0-447b-b277-546321457f6a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for user 1f95ff4743414cbc8cc9a213e508113b and project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:55:03.298014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-84068fc2-dac0-447b-b277-546321457f6a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168290 Jun 15 14:55:03.300018 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 448/915] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 14:55:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:03.351108 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5ba1a05f-c84b-430c-b033-7bf45ba2d652 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:03.351720 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5ba1a05f-c84b-430c-b033-7bf45ba2d652 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:03.360569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5ba1a05f-c84b-430c-b033-7bf45ba2d652 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:03.361125 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5ba1a05f-c84b-430c-b033-7bf45ba2d652 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:03.362249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5ba1a05f-c84b-430c-b033-7bf45ba2d652 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:03.363464 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5ba1a05f-c84b-430c-b033-7bf45ba2d652 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:03.512049 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5ba1a05f-c84b-430c-b033-7bf45ba2d652 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:03.519666 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5ba1a05f-c84b-430c-b033-7bf45ba2d652 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.172989 Jun 15 14:55:03.520230 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 468/916] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:03 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:04.536736 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-22c070ce-bc53-4e45-bbf5-763666546507 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:04.537349 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-22c070ce-bc53-4e45-bbf5-763666546507 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:04.546880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22c070ce-bc53-4e45-bbf5-763666546507 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:04.547365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22c070ce-bc53-4e45-bbf5-763666546507 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:04.548139 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22c070ce-bc53-4e45-bbf5-763666546507 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:04.549032 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22c070ce-bc53-4e45-bbf5-763666546507 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:04.573212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-178401481", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3fe8514-b139-4a79-925c-aad99761c6b3"}], "security_groups": [{"name": "tempest-securitygroup--73154597"}], "key_name": "tempest-keypair-2101857716", "user_data": "}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:04.735284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] validate_networks() for [('f3fe8514-b139-4a79-925c-aad99761c6b3', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:55:04.736758 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-22c070ce-bc53-4e45-bbf5-763666546507 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:04.745553 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-22c070ce-bc53-4e45-bbf5-763666546507 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.213188 Jun 15 14:55:04.755789 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 449/917] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:04 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:05.150879 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:55:05.151382 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:55:05.151853 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:55:05.152265 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:55:05.152665 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:55:05.162361 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:05.162808 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:05.163907 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:05.164335 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:05.183353 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:55:05.187792 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for user 1f95ff4743414cbc8cc9a213e508113b and project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:55:05.200528 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:55:05.202834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:55:05.259100 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b5ed3375-8662-4170-9a8c-b945c8964548 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.691108 Jun 15 14:55:05.259782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 469/918] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:55:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:55:05.270090 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3d75bfb8-216b-42f3-adee-0489d9839e3f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:05.271014 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3d75bfb8-216b-42f3-adee-0489d9839e3f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:05.329645 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3d75bfb8-216b-42f3-adee-0489d9839e3f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:05.337047 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3d75bfb8-216b-42f3-adee-0489d9839e3f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1241 microversion: 2.1 time: 0.070972 Jun 15 14:55:05.338190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 450/919] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:05 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:05.764047 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cf0892e0-a633-473b-b362-075aeb2d9e42 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:05.764734 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cf0892e0-a633-473b-b362-075aeb2d9e42 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:05.780120 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cf0892e0-a633-473b-b362-075aeb2d9e42 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:05.780936 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cf0892e0-a633-473b-b362-075aeb2d9e42 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:05.781987 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cf0892e0-a633-473b-b362-075aeb2d9e42 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:05.783609 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cf0892e0-a633-473b-b362-075aeb2d9e42 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:05.984598 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cf0892e0-a633-473b-b362-075aeb2d9e42 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:05.992703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cf0892e0-a633-473b-b362-075aeb2d9e42 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.233697 Jun 15 14:55:05.995486 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 470/920] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:05 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:06.356759 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7b359357-c6a3-4036-9a0a-7d6478d1ad9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:06.358903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7b359357-c6a3-4036-9a0a-7d6478d1ad9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:06.367261 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b359357-c6a3-4036-9a0a-7d6478d1ad9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:06.367725 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b359357-c6a3-4036-9a0a-7d6478d1ad9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:06.368515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b359357-c6a3-4036-9a0a-7d6478d1ad9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:06.370336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b359357-c6a3-4036-9a0a-7d6478d1ad9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:06.396126 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:06.466722 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7b359357-c6a3-4036-9a0a-7d6478d1ad9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:06.476558 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7b359357-c6a3-4036-9a0a-7d6478d1ad9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1293 microversion: 2.1 time: 0.125452 Jun 15 14:55:06.477415 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 451/921] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:06 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:07.013479 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-03252eb3-ce0b-4541-a99a-ea55fe7f57f0 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:07.014100 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-03252eb3-ce0b-4541-a99a-ea55fe7f57f0 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:07.020246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03252eb3-ce0b-4541-a99a-ea55fe7f57f0 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:07.020699 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03252eb3-ce0b-4541-a99a-ea55fe7f57f0 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:07.021473 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03252eb3-ce0b-4541-a99a-ea55fe7f57f0 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:07.021911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03252eb3-ce0b-4541-a99a-ea55fe7f57f0 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:07.230541 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-03252eb3-ce0b-4541-a99a-ea55fe7f57f0 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:07.238197 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-03252eb3-ce0b-4541-a99a-ea55fe7f57f0 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.229275 Jun 15 14:55:07.238968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 471/922] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:07 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:07.496601 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-40d9cb5d-897b-4e14-8e4d-50fe015d0b3d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:07.497326 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-40d9cb5d-897b-4e14-8e4d-50fe015d0b3d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:07.505700 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40d9cb5d-897b-4e14-8e4d-50fe015d0b3d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:07.506415 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40d9cb5d-897b-4e14-8e4d-50fe015d0b3d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:07.507290 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40d9cb5d-897b-4e14-8e4d-50fe015d0b3d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:07.507962 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40d9cb5d-897b-4e14-8e4d-50fe015d0b3d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:07.715099 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-40d9cb5d-897b-4e14-8e4d-50fe015d0b3d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:07.724444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-40d9cb5d-897b-4e14-8e4d-50fe015d0b3d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.233608 Jun 15 14:55:07.735245 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 452/923] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:07 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:08.260635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-27e85207-6b96-4b66-8003-66f89752d2a5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:08.261280 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-27e85207-6b96-4b66-8003-66f89752d2a5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:08.269695 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-27e85207-6b96-4b66-8003-66f89752d2a5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:08.270151 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-27e85207-6b96-4b66-8003-66f89752d2a5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:08.270920 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-27e85207-6b96-4b66-8003-66f89752d2a5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:08.271451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-27e85207-6b96-4b66-8003-66f89752d2a5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:08.345980 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-51689ca2-cda9-4171-aaa9-0e602c17f623 req-bd3f5849-d63e-4830-bad9-47ceec4e2813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab621e7-097d-4967-b97e-713c90996caf", "tag": "8963b9b8-5e1d-4373-ab84-11a26d38f437"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:08.359133 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-51689ca2-cda9-4171-aaa9-0e602c17f623 req-bd3f5849-d63e-4830-bad9-47ceec4e2813 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:08.359860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-51689ca2-cda9-4171-aaa9-0e602c17f623 req-bd3f5849-d63e-4830-bad9-47ceec4e2813 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:08.364329 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:08.373900 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-51689ca2-cda9-4171-aaa9-0e602c17f623 req-bd3f5849-d63e-4830-bad9-47ceec4e2813 service nova] Creating event network-changed:8963b9b8-5e1d-4373-ab84-11a26d38f437 for instance 7ab621e7-097d-4967-b97e-713c90996caf on hv-cinder-80382 Jun 15 14:55:08.379555 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-51689ca2-cda9-4171-aaa9-0e602c17f623 req-bd3f5849-d63e-4830-bad9-47ceec4e2813 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133746 Jun 15 14:55:08.380162 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 472/924] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:08.752646 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d38e2c6f-5f89-4732-840d-ecfe342b10f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:08.756702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d38e2c6f-5f89-4732-840d-ecfe342b10f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:08.765546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d38e2c6f-5f89-4732-840d-ecfe342b10f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:08.766045 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d38e2c6f-5f89-4732-840d-ecfe342b10f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:08.767522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d38e2c6f-5f89-4732-840d-ecfe342b10f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:08.768224 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d38e2c6f-5f89-4732-840d-ecfe342b10f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:08.792967 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-27e85207-6b96-4b66-8003-66f89752d2a5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:08.809269 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-27e85207-6b96-4b66-8003-66f89752d2a5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.555661 Jun 15 14:55:08.810452 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 453/925] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:08 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:08.975594 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d38e2c6f-5f89-4732-840d-ecfe342b10f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:08.983533 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d38e2c6f-5f89-4732-840d-ecfe342b10f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.244651 Jun 15 14:55:08.984102 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 473/926] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:08 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:09.825331 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f9dc6dbb-1b27-4059-b561-1414420253a8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:09.825941 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f9dc6dbb-1b27-4059-b561-1414420253a8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:09.832356 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dbb-1b27-4059-b561-1414420253a8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:09.832801 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dbb-1b27-4059-b561-1414420253a8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:09.833557 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dbb-1b27-4059-b561-1414420253a8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:09.833988 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dbb-1b27-4059-b561-1414420253a8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:09.969598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f9dc6dbb-1b27-4059-b561-1414420253a8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:09.983623 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f9dc6dbb-1b27-4059-b561-1414420253a8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.161749 Jun 15 14:55:09.984738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 454/927] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:09 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:10.000165 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3042154e-5608-4f42-946a-f672c6e3bbdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:10.000862 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3042154e-5608-4f42-946a-f672c6e3bbdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:10.007677 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3042154e-5608-4f42-946a-f672c6e3bbdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:10.008167 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3042154e-5608-4f42-946a-f672c6e3bbdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:10.008976 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3042154e-5608-4f42-946a-f672c6e3bbdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:10.009450 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3042154e-5608-4f42-946a-f672c6e3bbdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:10.137251 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3042154e-5608-4f42-946a-f672c6e3bbdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:10.144695 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3042154e-5608-4f42-946a-f672c6e3bbdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.148452 Jun 15 14:55:10.145262 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 474/928] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:09 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:10.999826 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8b1f9b4b-f051-496a-adb4-7d5b913d1fb7 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:11.000369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8b1f9b4b-f051-496a-adb4-7d5b913d1fb7 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:11.002619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:11.008569 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8b1f9b4b-f051-496a-adb4-7d5b913d1fb7 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:11.008786 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8b1f9b4b-f051-496a-adb4-7d5b913d1fb7 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:11.009529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8b1f9b4b-f051-496a-adb4-7d5b913d1fb7 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:11.009959 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8b1f9b4b-f051-496a-adb4-7d5b913d1fb7 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:11.141275 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8b1f9b4b-f051-496a-adb4-7d5b913d1fb7 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:11.148677 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8b1f9b4b-f051-496a-adb4-7d5b913d1fb7 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.152769 Jun 15 14:55:11.149231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 455/929] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:10 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:11.161588 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-45c20ef7-8846-4174-b733-419afd5c57e8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:11.162344 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-45c20ef7-8846-4174-b733-419afd5c57e8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:11.165163 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:11.171248 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-45c20ef7-8846-4174-b733-419afd5c57e8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:11.171707 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-45c20ef7-8846-4174-b733-419afd5c57e8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:11.172521 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-45c20ef7-8846-4174-b733-419afd5c57e8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:11.172962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-45c20ef7-8846-4174-b733-419afd5c57e8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:11.303515 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-45c20ef7-8846-4174-b733-419afd5c57e8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:11.310900 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-45c20ef7-8846-4174-b733-419afd5c57e8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.153201 Jun 15 14:55:11.311600 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 475/930] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:11 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:12.165981 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d1912a34-dca0-4d9a-90b0-5e613b711d70 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:12.166591 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d1912a34-dca0-4d9a-90b0-5e613b711d70 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:12.173055 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d1912a34-dca0-4d9a-90b0-5e613b711d70 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:12.173507 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d1912a34-dca0-4d9a-90b0-5e613b711d70 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:12.174275 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d1912a34-dca0-4d9a-90b0-5e613b711d70 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:12.174713 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d1912a34-dca0-4d9a-90b0-5e613b711d70 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:12.301620 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d1912a34-dca0-4d9a-90b0-5e613b711d70 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:12.309596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d1912a34-dca0-4d9a-90b0-5e613b711d70 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.148230 Jun 15 14:55:12.310159 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 456/931] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:12 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:12.327651 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-73c5506c-2bdd-462a-af83-2df064b185b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:12.328248 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-73c5506c-2bdd-462a-af83-2df064b185b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:12.335051 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-73c5506c-2bdd-462a-af83-2df064b185b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:12.335498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-73c5506c-2bdd-462a-af83-2df064b185b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:12.336253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-73c5506c-2bdd-462a-af83-2df064b185b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:12.336684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-73c5506c-2bdd-462a-af83-2df064b185b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:12.464810 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-73c5506c-2bdd-462a-af83-2df064b185b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:12.472232 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-73c5506c-2bdd-462a-af83-2df064b185b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.148428 Jun 15 14:55:12.472783 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 476/932] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:12 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:13.326394 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-69f84cb0-4f05-455e-918d-070044763083 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:13.326960 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-69f84cb0-4f05-455e-918d-070044763083 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:13.333594 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-69f84cb0-4f05-455e-918d-070044763083 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:13.334047 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-69f84cb0-4f05-455e-918d-070044763083 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:13.334805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-69f84cb0-4f05-455e-918d-070044763083 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:13.335265 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-69f84cb0-4f05-455e-918d-070044763083 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:13.461171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-69f84cb0-4f05-455e-918d-070044763083 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:13.468588 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-69f84cb0-4f05-455e-918d-070044763083 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.146767 Jun 15 14:55:13.469138 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 457/933] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:13 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:13.489641 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8c97c889-1174-4ca2-b89b-b074687ef6ec tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:13.490281 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8c97c889-1174-4ca2-b89b-b074687ef6ec tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:13.497298 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8c97c889-1174-4ca2-b89b-b074687ef6ec tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:13.497749 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8c97c889-1174-4ca2-b89b-b074687ef6ec tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:13.498505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8c97c889-1174-4ca2-b89b-b074687ef6ec tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:13.498942 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8c97c889-1174-4ca2-b89b-b074687ef6ec tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:13.630854 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8c97c889-1174-4ca2-b89b-b074687ef6ec tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:13.638252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8c97c889-1174-4ca2-b89b-b074687ef6ec tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.152607 Jun 15 14:55:13.638814 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 477/934] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:13 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:14.485081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6d3319fa-85f3-42a9-b47a-7ff9a037917c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:14.485691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6d3319fa-85f3-42a9-b47a-7ff9a037917c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:14.492157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6d3319fa-85f3-42a9-b47a-7ff9a037917c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:14.492606 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6d3319fa-85f3-42a9-b47a-7ff9a037917c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:14.493406 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6d3319fa-85f3-42a9-b47a-7ff9a037917c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:14.493844 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6d3319fa-85f3-42a9-b47a-7ff9a037917c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:14.622030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6d3319fa-85f3-42a9-b47a-7ff9a037917c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:14.629478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6d3319fa-85f3-42a9-b47a-7ff9a037917c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.148321 Jun 15 14:55:14.630041 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 458/935] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:14 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:14.655384 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-adda3d24-85fd-4e7c-8b24-3e6c8de0e90d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:14.655988 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-adda3d24-85fd-4e7c-8b24-3e6c8de0e90d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:14.662580 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-adda3d24-85fd-4e7c-8b24-3e6c8de0e90d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:14.663059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-adda3d24-85fd-4e7c-8b24-3e6c8de0e90d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:14.664074 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-adda3d24-85fd-4e7c-8b24-3e6c8de0e90d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:14.664511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-adda3d24-85fd-4e7c-8b24-3e6c8de0e90d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:14.793882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-adda3d24-85fd-4e7c-8b24-3e6c8de0e90d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:14.801252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-adda3d24-85fd-4e7c-8b24-3e6c8de0e90d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.149669 Jun 15 14:55:14.801827 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 478/936] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:14 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:15.646189 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-790f6a57-b174-432b-8cb6-23bb4dc96da6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:15.646826 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-790f6a57-b174-432b-8cb6-23bb4dc96da6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:15.650267 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=8 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:15.654753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-790f6a57-b174-432b-8cb6-23bb4dc96da6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:15.655233 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-790f6a57-b174-432b-8cb6-23bb4dc96da6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:15.655995 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-790f6a57-b174-432b-8cb6-23bb4dc96da6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:15.656426 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-790f6a57-b174-432b-8cb6-23bb4dc96da6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:15.785848 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-790f6a57-b174-432b-8cb6-23bb4dc96da6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:15.794452 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-790f6a57-b174-432b-8cb6-23bb4dc96da6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.152092 Jun 15 14:55:15.795032 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 459/937] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:15 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:15.817496 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-81681c1c-3a40-47aa-b4b1-db7f977c0c2e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:15.818138 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-81681c1c-3a40-47aa-b4b1-db7f977c0c2e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:15.820041 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=4 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:15.820719 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=12 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:15.827021 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-81681c1c-3a40-47aa-b4b1-db7f977c0c2e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:15.827478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-81681c1c-3a40-47aa-b4b1-db7f977c0c2e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:15.828239 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-81681c1c-3a40-47aa-b4b1-db7f977c0c2e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:15.828719 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-81681c1c-3a40-47aa-b4b1-db7f977c0c2e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:15.953770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-81681c1c-3a40-47aa-b4b1-db7f977c0c2e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:15.961206 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-81681c1c-3a40-47aa-b4b1-db7f977c0c2e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.147553 Jun 15 14:55:15.961764 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 479/938] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:15 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:16.811653 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ddcdac87-09f9-4b79-a22f-58da7aaa5df2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:16.812261 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ddcdac87-09f9-4b79-a22f-58da7aaa5df2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:16.818709 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddcdac87-09f9-4b79-a22f-58da7aaa5df2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:16.819191 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddcdac87-09f9-4b79-a22f-58da7aaa5df2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:16.819958 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddcdac87-09f9-4b79-a22f-58da7aaa5df2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:16.820432 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddcdac87-09f9-4b79-a22f-58da7aaa5df2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:16.953439 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ddcdac87-09f9-4b79-a22f-58da7aaa5df2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:16.960733 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ddcdac87-09f9-4b79-a22f-58da7aaa5df2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.152979 Jun 15 14:55:16.961286 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 460/939] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:16 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:16.977550 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-97f53295-d986-4785-8941-b40d1679f21e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:16.978754 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-97f53295-d986-4785-8941-b40d1679f21e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:16.985202 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-97f53295-d986-4785-8941-b40d1679f21e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:16.985649 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-97f53295-d986-4785-8941-b40d1679f21e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:16.986407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-97f53295-d986-4785-8941-b40d1679f21e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:16.986847 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-97f53295-d986-4785-8941-b40d1679f21e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:17.118658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-97f53295-d986-4785-8941-b40d1679f21e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:17.126048 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-97f53295-d986-4785-8941-b40d1679f21e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.152403 Jun 15 14:55:17.126620 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 480/940] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:16 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:17.978204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-085da1bb-8c99-4a39-9736-7f9e60d1fac8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:17.978890 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-085da1bb-8c99-4a39-9736-7f9e60d1fac8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:17.985738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-085da1bb-8c99-4a39-9736-7f9e60d1fac8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:17.986218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-085da1bb-8c99-4a39-9736-7f9e60d1fac8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:17.986980 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-085da1bb-8c99-4a39-9736-7f9e60d1fac8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:17.987442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-085da1bb-8c99-4a39-9736-7f9e60d1fac8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:18.124892 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-085da1bb-8c99-4a39-9736-7f9e60d1fac8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:18.132726 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-085da1bb-8c99-4a39-9736-7f9e60d1fac8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.158726 Jun 15 14:55:18.133278 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 461/941] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:17 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:18.142301 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1729d50d-de4b-4adc-b76d-203cd4c2c3a9 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:18.142910 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1729d50d-de4b-4adc-b76d-203cd4c2c3a9 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:18.149392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1729d50d-de4b-4adc-b76d-203cd4c2c3a9 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:18.149844 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1729d50d-de4b-4adc-b76d-203cd4c2c3a9 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:18.150602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1729d50d-de4b-4adc-b76d-203cd4c2c3a9 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:18.151068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1729d50d-de4b-4adc-b76d-203cd4c2c3a9 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:18.281684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1729d50d-de4b-4adc-b76d-203cd4c2c3a9 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:18.290870 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1729d50d-de4b-4adc-b76d-203cd4c2c3a9 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.151884 Jun 15 14:55:18.291468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 481/942] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:18 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:19.149190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d85c9137-4ba3-4ca3-901a-e82afa2d8a64 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:19.150334 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d85c9137-4ba3-4ca3-901a-e82afa2d8a64 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:19.156818 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d85c9137-4ba3-4ca3-901a-e82afa2d8a64 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:19.157267 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d85c9137-4ba3-4ca3-901a-e82afa2d8a64 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:19.158032 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d85c9137-4ba3-4ca3-901a-e82afa2d8a64 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:19.158467 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d85c9137-4ba3-4ca3-901a-e82afa2d8a64 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:19.286892 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d85c9137-4ba3-4ca3-901a-e82afa2d8a64 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:19.295094 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d85c9137-4ba3-4ca3-901a-e82afa2d8a64 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.149805 Jun 15 14:55:19.295652 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 462/943] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:19 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:19.307410 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f9cb6bbe-62d0-4796-985e-dc4f3acfd68e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:19.308014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f9cb6bbe-62d0-4796-985e-dc4f3acfd68e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:19.314508 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f9cb6bbe-62d0-4796-985e-dc4f3acfd68e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:19.314954 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f9cb6bbe-62d0-4796-985e-dc4f3acfd68e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:19.315746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f9cb6bbe-62d0-4796-985e-dc4f3acfd68e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:19.316178 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f9cb6bbe-62d0-4796-985e-dc4f3acfd68e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:19.443634 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f9cb6bbe-62d0-4796-985e-dc4f3acfd68e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:19.450824 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f9cb6bbe-62d0-4796-985e-dc4f3acfd68e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.147239 Jun 15 14:55:19.451408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 482/944] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:19 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:19.884653 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-8fdb96a5-112a-48e0-940c-a1dc063ebd57 req-17703c6e-f89e-4576-8e2c-bdd9fa1041a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab621e7-097d-4967-b97e-713c90996caf", "name": "network-vif-plugged", "status": "completed", "tag": "8963b9b8-5e1d-4373-ab84-11a26d38f437"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:19.892941 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8fdb96a5-112a-48e0-940c-a1dc063ebd57 req-17703c6e-f89e-4576-8e2c-bdd9fa1041a6 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:19.893585 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8fdb96a5-112a-48e0-940c-a1dc063ebd57 req-17703c6e-f89e-4576-8e2c-bdd9fa1041a6 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:19.906495 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-8fdb96a5-112a-48e0-940c-a1dc063ebd57 req-17703c6e-f89e-4576-8e2c-bdd9fa1041a6 service nova] Creating event network-vif-plugged:8963b9b8-5e1d-4373-ab84-11a26d38f437 for instance 7ab621e7-097d-4967-b97e-713c90996caf on hv-cinder-80382 Jun 15 14:55:19.913515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-8fdb96a5-112a-48e0-940c-a1dc063ebd57 req-17703c6e-f89e-4576-8e2c-bdd9fa1041a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090017 Jun 15 14:55:19.914451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 463/945] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:55:20.312581 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-c71a9c32-39df-49fc-adf7-3f3ee9bf1aa3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:20.313197 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-c71a9c32-39df-49fc-adf7-3f3ee9bf1aa3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:20.320072 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c71a9c32-39df-49fc-adf7-3f3ee9bf1aa3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:20.320532 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c71a9c32-39df-49fc-adf7-3f3ee9bf1aa3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:20.321313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c71a9c32-39df-49fc-adf7-3f3ee9bf1aa3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:20.321751 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-c71a9c32-39df-49fc-adf7-3f3ee9bf1aa3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:20.459578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-c71a9c32-39df-49fc-adf7-3f3ee9bf1aa3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:20.467649 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-c71a9c32-39df-49fc-adf7-3f3ee9bf1aa3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.159027 Jun 15 14:55:20.468061 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-25be9868-bad4-4c60-959e-2c45079717d2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:20.468768 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-25be9868-bad4-4c60-959e-2c45079717d2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:20.476742 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 483/946] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:20 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:20.477077 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25be9868-bad4-4c60-959e-2c45079717d2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:20.477198 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25be9868-bad4-4c60-959e-2c45079717d2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:20.478464 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25be9868-bad4-4c60-959e-2c45079717d2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:20.479158 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25be9868-bad4-4c60-959e-2c45079717d2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:20.607433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-25be9868-bad4-4c60-959e-2c45079717d2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:20.614849 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-25be9868-bad4-4c60-959e-2c45079717d2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.150963 Jun 15 14:55:20.615448 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 464/947] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:20 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:21.484602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-42013cc7-4b55-45da-b7af-059fe519edfb tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:21.485225 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-42013cc7-4b55-45da-b7af-059fe519edfb tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:21.491808 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-42013cc7-4b55-45da-b7af-059fe519edfb tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:21.492263 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-42013cc7-4b55-45da-b7af-059fe519edfb tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:21.493026 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-42013cc7-4b55-45da-b7af-059fe519edfb tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:21.493464 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-42013cc7-4b55-45da-b7af-059fe519edfb tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:21.628304 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-42013cc7-4b55-45da-b7af-059fe519edfb tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:21.632486 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a271e33d-30e6-4898-8c56-ef76d3063dc7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:21.633091 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a271e33d-30e6-4898-8c56-ef76d3063dc7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:21.639302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-42013cc7-4b55-45da-b7af-059fe519edfb tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.157725 Jun 15 14:55:21.640102 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a271e33d-30e6-4898-8c56-ef76d3063dc7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:21.640226 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 484/948] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:21 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:21.640334 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a271e33d-30e6-4898-8c56-ef76d3063dc7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:21.641068 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a271e33d-30e6-4898-8c56-ef76d3063dc7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:21.641506 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a271e33d-30e6-4898-8c56-ef76d3063dc7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:21.775653 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a271e33d-30e6-4898-8c56-ef76d3063dc7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:21.783131 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a271e33d-30e6-4898-8c56-ef76d3063dc7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1365 microversion: 2.1 time: 0.154637 Jun 15 14:55:21.783707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 465/949] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:21 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:21.927544 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-8597b6b4-afe0-473e-a885-d90de4050999 req-b0aa1df1-4ca4-4e21-a062-568a81a6ef16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c62c5ab-613d-4a52-95e0-7ffe043a9628", "name": "network-vif-plugged", "status": "completed", "tag": "62922aed-bb0a-4def-8adc-0a60c9968f87"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:21.935641 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-8597b6b4-afe0-473e-a885-d90de4050999 req-b0aa1df1-4ca4-4e21-a062-568a81a6ef16 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:21.936086 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-8597b6b4-afe0-473e-a885-d90de4050999 req-b0aa1df1-4ca4-4e21-a062-568a81a6ef16 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:21.947323 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-8597b6b4-afe0-473e-a885-d90de4050999 req-b0aa1df1-4ca4-4e21-a062-568a81a6ef16 service nova] Creating event network-vif-plugged:62922aed-bb0a-4def-8adc-0a60c9968f87 for instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 on hv-cinder-80382 Jun 15 14:55:21.952137 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-8597b6b4-afe0-473e-a885-d90de4050999 req-b0aa1df1-4ca4-4e21-a062-568a81a6ef16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028289 Jun 15 14:55:21.953055 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 485/950] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:22.655442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-91362ed5-83d4-431d-8d28-878e4b150893 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:22.656058 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-91362ed5-83d4-431d-8d28-878e4b150893 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:22.662466 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91362ed5-83d4-431d-8d28-878e4b150893 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:22.662898 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91362ed5-83d4-431d-8d28-878e4b150893 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:22.663698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91362ed5-83d4-431d-8d28-878e4b150893 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:22.664396 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91362ed5-83d4-431d-8d28-878e4b150893 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:22.801637 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0c148ea4-2099-49ba-a706-44e4f25387be tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:22.802344 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0c148ea4-2099-49ba-a706-44e4f25387be tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:22.809427 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-91362ed5-83d4-431d-8d28-878e4b150893 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:22.809596 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0c148ea4-2099-49ba-a706-44e4f25387be tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:22.809881 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0c148ea4-2099-49ba-a706-44e4f25387be tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:22.810658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0c148ea4-2099-49ba-a706-44e4f25387be tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:22.811185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0c148ea4-2099-49ba-a706-44e4f25387be tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:22.817203 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-91362ed5-83d4-431d-8d28-878e4b150893 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.165647 Jun 15 14:55:22.817782 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 466/951] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:22 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:22.938946 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0c148ea4-2099-49ba-a706-44e4f25387be tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:22.946335 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0c148ea4-2099-49ba-a706-44e4f25387be tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1555 microversion: 2.1 time: 0.149550 Jun 15 14:55:22.946944 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 486/952] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:22 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:22.962811 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-759fae07-87c9-48f7-bb4c-9f862071903d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:22.963323 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-759fae07-87c9-48f7-bb4c-9f862071903d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:22.969289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-759fae07-87c9-48f7-bb4c-9f862071903d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:22.969672 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-759fae07-87c9-48f7-bb4c-9f862071903d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:22.970423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-759fae07-87c9-48f7-bb4c-9f862071903d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:22.970853 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-759fae07-87c9-48f7-bb4c-9f862071903d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.045735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-759fae07-87c9-48f7-bb4c-9f862071903d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087266 Jun 15 14:55:23.046321 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 467/953] 10.222.0.45 () {58 vars in 1274 bytes} [Wed Jun 15 14:55:22 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:23.833663 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1a16f53d-15d3-43c1-b0f1-ba1a6f3c3155 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:23.834376 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1a16f53d-15d3-43c1-b0f1-ba1a6f3c3155 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:23.841104 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1a16f53d-15d3-43c1-b0f1-ba1a6f3c3155 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.841657 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1a16f53d-15d3-43c1-b0f1-ba1a6f3c3155 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.842496 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1a16f53d-15d3-43c1-b0f1-ba1a6f3c3155 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.843025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1a16f53d-15d3-43c1-b0f1-ba1a6f3c3155 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.951902 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-4d5beffc-df5f-4611-a3b2-8d2aab78a6ba req-5760a4b2-d726-463a-8e56-da3c1b73e7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab621e7-097d-4967-b97e-713c90996caf", "tag": "8963b9b8-5e1d-4373-ab84-11a26d38f437"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:23.960023 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-4d5beffc-df5f-4611-a3b2-8d2aab78a6ba req-5760a4b2-d726-463a-8e56-da3c1b73e7e2 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.960557 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-4d5beffc-df5f-4611-a3b2-8d2aab78a6ba req-5760a4b2-d726-463a-8e56-da3c1b73e7e2 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.972108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-4d5beffc-df5f-4611-a3b2-8d2aab78a6ba req-5760a4b2-d726-463a-8e56-da3c1b73e7e2 service nova] Creating event network-changed:8963b9b8-5e1d-4373-ab84-11a26d38f437 for instance 7ab621e7-097d-4967-b97e-713c90996caf on hv-cinder-80382 Jun 15 14:55:23.977200 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-4d5beffc-df5f-4611-a3b2-8d2aab78a6ba req-5760a4b2-d726-463a-8e56-da3c1b73e7e2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030310 Jun 15 14:55:23.978031 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 468/954] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:55:23.986225 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1a16f53d-15d3-43c1-b0f1-ba1a6f3c3155 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:23.994128 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1a16f53d-15d3-43c1-b0f1-ba1a6f3c3155 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1265 microversion: 2.1 time: 0.163872 Jun 15 14:55:23.994696 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 487/955] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:23 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:25.012174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-81b529a1-a4a9-4deb-8191-841dd6eb4a7d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:25.013596 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-81b529a1-a4a9-4deb-8191-841dd6eb4a7d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:25.020431 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81b529a1-a4a9-4deb-8191-841dd6eb4a7d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:25.020866 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81b529a1-a4a9-4deb-8191-841dd6eb4a7d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:25.021711 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81b529a1-a4a9-4deb-8191-841dd6eb4a7d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:25.022189 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81b529a1-a4a9-4deb-8191-841dd6eb4a7d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:25.214668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-81b529a1-a4a9-4deb-8191-841dd6eb4a7d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:25.218235 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:25.223123 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-81b529a1-a4a9-4deb-8191-841dd6eb4a7d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1452 microversion: 2.1 time: 0.215698 Jun 15 14:55:25.223689 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 469/956] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:25 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:25.239475 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4987e831-9381-4cfc-8804-af56978cb0f9 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:25.240087 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4987e831-9381-4cfc-8804-af56978cb0f9 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:25.246679 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4987e831-9381-4cfc-8804-af56978cb0f9 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:25.247170 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4987e831-9381-4cfc-8804-af56978cb0f9 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:25.247933 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4987e831-9381-4cfc-8804-af56978cb0f9 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:25.248368 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4987e831-9381-4cfc-8804-af56978cb0f9 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:25.381110 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4987e831-9381-4cfc-8804-af56978cb0f9 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:25.388607 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4987e831-9381-4cfc-8804-af56978cb0f9 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1452 microversion: 2.1 time: 0.153135 Jun 15 14:55:25.389173 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 488/957] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:25 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:27.487931 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-2f1ccfb3-5451-4919-9613-90cd19d35134 req-fcad1893-03ac-4388-984c-1a6301e2fb3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c62c5ab-613d-4a52-95e0-7ffe043a9628", "tag": "62922aed-bb0a-4def-8adc-0a60c9968f87"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:27.496664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-2f1ccfb3-5451-4919-9613-90cd19d35134 req-fcad1893-03ac-4388-984c-1a6301e2fb3e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:27.497106 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-2f1ccfb3-5451-4919-9613-90cd19d35134 req-fcad1893-03ac-4388-984c-1a6301e2fb3e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:27.510282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-2f1ccfb3-5451-4919-9613-90cd19d35134 req-fcad1893-03ac-4388-984c-1a6301e2fb3e service nova] Creating event network-changed:62922aed-bb0a-4def-8adc-0a60c9968f87 for instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 on hv-cinder-80382 Jun 15 14:55:27.515277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-2f1ccfb3-5451-4919-9613-90cd19d35134 req-fcad1893-03ac-4388-984c-1a6301e2fb3e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031421 Jun 15 14:55:27.515861 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 470/958] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:42.283797 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=27 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:42.284538 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=92 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:42.289212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e2a6558d-7fb5-4edb-9b2d-c16ab7a6c191 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:42.289958 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e2a6558d-7fb5-4edb-9b2d-c16ab7a6c191 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:42.297173 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e2a6558d-7fb5-4edb-9b2d-c16ab7a6c191 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.297620 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e2a6558d-7fb5-4edb-9b2d-c16ab7a6c191 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.298371 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e2a6558d-7fb5-4edb-9b2d-c16ab7a6c191 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.298804 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e2a6558d-7fb5-4edb-9b2d-c16ab7a6c191 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.321698 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e2a6558d-7fb5-4edb-9b2d-c16ab7a6c191 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/ips" status: 200 len: 148 microversion: 2.1 time: 0.039816 Jun 15 14:56:42.322180 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 489/959] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 14:56:42 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:43.659422 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=31 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:43.660157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:43.665361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f24e4060-5da0-4ea4-93e8-30ae5578d98d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aadb4c62-b7d3-46c1-b632-3d10aa79e4d3"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:43.666483 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f24e4060-5da0-4ea4-93e8-30ae5578d98d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:43.673369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f24e4060-5da0-4ea4-93e8-30ae5578d98d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:43.673815 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f24e4060-5da0-4ea4-93e8-30ae5578d98d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:43.674588 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f24e4060-5da0-4ea4-93e8-30ae5578d98d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:43.675029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f24e4060-5da0-4ea4-93e8-30ae5578d98d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:43.931621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f24e4060-5da0-4ea4-93e8-30ae5578d98d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274248 Jun 15 14:56:43.932237 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 471/960] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:56:43 2022] POST /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:51.412860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5927f85a-47eb-4928-b6f4-f1318862f544 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: .version_select at 0x7f05b76089d0>, body: {"keypair": {"name": "tempest-keypair-983282135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcBirqPFM52xy5aJEgKGj6Hcn6D8Y8ax0c3EpbkJn4aYD83EwTSFhU9uskN6kOH3qWUFuBp0ZgyW5d4/2pQQ0/8D51mM6rpO3T2K7Txw+OXr2zkUUBu6cubsDjBz66KXw=="}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:51.427245 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-5927f85a-47eb-4928-b6f4-f1318862f544 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:56:51.431053 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-5927f85a-47eb-4928-b6f4-f1318862f544 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for user 1f95ff4743414cbc8cc9a213e508113b and project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:56:51.452737 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5927f85a-47eb-4928-b6f4-f1318862f544 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043739 Jun 15 14:56:51.453309 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 490/961] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 14:56:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:56:52.687670 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1336324640", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3fe8514-b139-4a79-925c-aad99761c6b3"}], "security_groups": [{"name": "tempest-securitygroup--697351880"}], "key_name": "tempest-keypair-983282135", "user_data": "}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:52.791575 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] validate_networks() for [('f3fe8514-b139-4a79-925c-aad99761c6b3', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:56:53.246361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:56:53.246784 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:56:53.247283 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:56:53.247693 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:56:53.248132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:56:53.256795 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:53.257243 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:53.258039 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:53.258478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:53.274694 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:56:53.278544 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for user 1f95ff4743414cbc8cc9a213e508113b and project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:56:53.289735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:56:53.292385 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:56:53.336719 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9903757b-53da-46e7-be65-9dbfba69403e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.654190 Jun 15 14:56:53.337361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 472/962] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:56:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:56:53.344773 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=4 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:53.349516 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d9b36031-f17f-41db-902c-b3089a59aa64 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:53.350180 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d9b36031-f17f-41db-902c-b3089a59aa64 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:53.403128 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d9b36031-f17f-41db-902c-b3089a59aa64 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:53.410354 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d9b36031-f17f-41db-902c-b3089a59aa64 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1241 microversion: 2.1 time: 0.066422 Jun 15 14:56:53.410914 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 491/963] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:53 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:54.427516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5ddedc85-f625-4eb0-8d30-b671f10b4347 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:54.428123 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5ddedc85-f625-4eb0-8d30-b671f10b4347 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:54.435021 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5ddedc85-f625-4eb0-8d30-b671f10b4347 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:54.435619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5ddedc85-f625-4eb0-8d30-b671f10b4347 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:54.437042 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5ddedc85-f625-4eb0-8d30-b671f10b4347 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:54.437473 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5ddedc85-f625-4eb0-8d30-b671f10b4347 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:54.495642 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5ddedc85-f625-4eb0-8d30-b671f10b4347 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:54.503685 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5ddedc85-f625-4eb0-8d30-b671f10b4347 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1237 microversion: 2.1 time: 0.080626 Jun 15 14:56:54.504243 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 473/964] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:54 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:55.520397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e3d73969-d29b-4a1a-8b4f-8a68cb5eb381 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:55.521667 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e3d73969-d29b-4a1a-8b4f-8a68cb5eb381 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:55.528095 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e3d73969-d29b-4a1a-8b4f-8a68cb5eb381 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:55.528543 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e3d73969-d29b-4a1a-8b4f-8a68cb5eb381 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:55.529305 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e3d73969-d29b-4a1a-8b4f-8a68cb5eb381 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:55.530251 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e3d73969-d29b-4a1a-8b4f-8a68cb5eb381 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:55.603264 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-e3d73969-d29b-4a1a-8b4f-8a68cb5eb381 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:55.611481 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e3d73969-d29b-4a1a-8b4f-8a68cb5eb381 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1299 microversion: 2.1 time: 0.094978 Jun 15 14:56:55.612061 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 492/965] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:55 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:56.540251 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-58edad2f-5831-4187-8692-59f786977921 req-07d4ba37-2c81-40bd-9363-4c77e5a120a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a004c55f-00c1-4c52-9103-f7c287937cd3", "tag": "ba1574e7-ba99-4ca7-b4b1-6814c0c45aa7"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:56.550433 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-58edad2f-5831-4187-8692-59f786977921 req-07d4ba37-2c81-40bd-9363-4c77e5a120a8 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:56.551316 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-58edad2f-5831-4187-8692-59f786977921 req-07d4ba37-2c81-40bd-9363-4c77e5a120a8 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:56.563363 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-58edad2f-5831-4187-8692-59f786977921 req-07d4ba37-2c81-40bd-9363-4c77e5a120a8 service nova] Creating event network-changed:ba1574e7-ba99-4ca7-b4b1-6814c0c45aa7 for instance a004c55f-00c1-4c52-9103-f7c287937cd3 on hv-cinder-80382 Jun 15 14:56:56.568990 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-58edad2f-5831-4187-8692-59f786977921 req-07d4ba37-2c81-40bd-9363-4c77e5a120a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034114 Jun 15 14:56:56.569746 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 474/966] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:56.630249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9246d4aa-b5ab-4d09-a45c-cc9ed88b0212 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:56.631501 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9246d4aa-b5ab-4d09-a45c-cc9ed88b0212 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:56.640505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9246d4aa-b5ab-4d09-a45c-cc9ed88b0212 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:56.640955 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9246d4aa-b5ab-4d09-a45c-cc9ed88b0212 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:56.641732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9246d4aa-b5ab-4d09-a45c-cc9ed88b0212 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:56.642171 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9246d4aa-b5ab-4d09-a45c-cc9ed88b0212 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:56.848849 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9246d4aa-b5ab-4d09-a45c-cc9ed88b0212 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:56.856286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9246d4aa-b5ab-4d09-a45c-cc9ed88b0212 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1366 microversion: 2.1 time: 0.231643 Jun 15 14:56:56.856852 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 493/967] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:56 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:57.873870 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2b1cd211-dc46-47f6-a1c6-2a9493e9795d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:57.874598 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2b1cd211-dc46-47f6-a1c6-2a9493e9795d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:57.880829 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2b1cd211-dc46-47f6-a1c6-2a9493e9795d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:57.881277 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2b1cd211-dc46-47f6-a1c6-2a9493e9795d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:57.882032 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2b1cd211-dc46-47f6-a1c6-2a9493e9795d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:57.882468 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2b1cd211-dc46-47f6-a1c6-2a9493e9795d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:58.011103 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2b1cd211-dc46-47f6-a1c6-2a9493e9795d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:58.018960 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2b1cd211-dc46-47f6-a1c6-2a9493e9795d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1366 microversion: 2.1 time: 0.149775 Jun 15 14:56:58.019542 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 475/968] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:57 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:59.035750 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ab461c98-8ab4-410a-90cd-98b60dfbce8c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:59.036322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ab461c98-8ab4-410a-90cd-98b60dfbce8c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:59.043175 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ab461c98-8ab4-410a-90cd-98b60dfbce8c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:59.043627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ab461c98-8ab4-410a-90cd-98b60dfbce8c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:59.044387 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ab461c98-8ab4-410a-90cd-98b60dfbce8c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:59.044828 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ab461c98-8ab4-410a-90cd-98b60dfbce8c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:59.179166 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ab461c98-8ab4-410a-90cd-98b60dfbce8c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:59.186677 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ab461c98-8ab4-410a-90cd-98b60dfbce8c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1366 microversion: 2.1 time: 0.154839 Jun 15 14:56:59.187353 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 494/969] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:59 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:00.204096 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b4513d46-c185-4ed4-8b00-8eb59e191e8a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:00.204712 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b4513d46-c185-4ed4-8b00-8eb59e191e8a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:00.211369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4513d46-c185-4ed4-8b00-8eb59e191e8a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:00.211826 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4513d46-c185-4ed4-8b00-8eb59e191e8a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:00.212599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4513d46-c185-4ed4-8b00-8eb59e191e8a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:00.213162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b4513d46-c185-4ed4-8b00-8eb59e191e8a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:00.344450 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b4513d46-c185-4ed4-8b00-8eb59e191e8a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:00.351880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b4513d46-c185-4ed4-8b00-8eb59e191e8a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1366 microversion: 2.1 time: 0.152362 Jun 15 14:57:00.352441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 476/970] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:00 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:01.369073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-53ee4b14-5f6b-4905-a1e1-171bf1013880 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:01.369686 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-53ee4b14-5f6b-4905-a1e1-171bf1013880 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:01.376676 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-53ee4b14-5f6b-4905-a1e1-171bf1013880 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:01.377157 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-53ee4b14-5f6b-4905-a1e1-171bf1013880 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:01.377919 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-53ee4b14-5f6b-4905-a1e1-171bf1013880 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:01.378364 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-53ee4b14-5f6b-4905-a1e1-171bf1013880 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:01.502726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-53ee4b14-5f6b-4905-a1e1-171bf1013880 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:01.510079 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-53ee4b14-5f6b-4905-a1e1-171bf1013880 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1366 microversion: 2.1 time: 0.144871 Jun 15 14:57:01.510640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 495/971] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:01 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:02.141278 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-d4c9df1e-abf5-4892-83cd-7b5accfb175e req-fa83a48a-0940-49b4-bbe8-9133d950dd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a004c55f-00c1-4c52-9103-f7c287937cd3", "name": "network-vif-plugged", "status": "completed", "tag": "ba1574e7-ba99-4ca7-b4b1-6814c0c45aa7"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:02.150240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-d4c9df1e-abf5-4892-83cd-7b5accfb175e req-fa83a48a-0940-49b4-bbe8-9133d950dd85 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:02.150728 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-d4c9df1e-abf5-4892-83cd-7b5accfb175e req-fa83a48a-0940-49b4-bbe8-9133d950dd85 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:02.164630 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-d4c9df1e-abf5-4892-83cd-7b5accfb175e req-fa83a48a-0940-49b4-bbe8-9133d950dd85 service nova] Creating event network-vif-plugged:ba1574e7-ba99-4ca7-b4b1-6814c0c45aa7 for instance a004c55f-00c1-4c52-9103-f7c287937cd3 on hv-cinder-80382 Jun 15 14:57:02.169968 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-d4c9df1e-abf5-4892-83cd-7b5accfb175e req-fa83a48a-0940-49b4-bbe8-9133d950dd85 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Jun 15 14:57:02.171291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 477/972] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:57:02.527442 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b98c6a63-03ff-4796-b971-19ef23565631 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:02.528056 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b98c6a63-03ff-4796-b971-19ef23565631 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:02.535158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b98c6a63-03ff-4796-b971-19ef23565631 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:02.535613 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b98c6a63-03ff-4796-b971-19ef23565631 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:02.536372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b98c6a63-03ff-4796-b971-19ef23565631 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:02.536809 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b98c6a63-03ff-4796-b971-19ef23565631 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:02.666745 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b98c6a63-03ff-4796-b971-19ef23565631 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:02.674054 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b98c6a63-03ff-4796-b971-19ef23565631 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1366 microversion: 2.1 time: 0.150594 Jun 15 14:57:02.674708 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 496/973] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:02 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:03.688618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:03.689429 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:03.693413 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5ccb61aa-0125-4c15-953b-3b63969106d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:03.694108 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5ccb61aa-0125-4c15-953b-3b63969106d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:03.701236 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5ccb61aa-0125-4c15-953b-3b63969106d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:03.701690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5ccb61aa-0125-4c15-953b-3b63969106d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:03.702463 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5ccb61aa-0125-4c15-953b-3b63969106d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:03.702899 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5ccb61aa-0125-4c15-953b-3b63969106d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:03.837723 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5ccb61aa-0125-4c15-953b-3b63969106d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:03.845143 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5ccb61aa-0125-4c15-953b-3b63969106d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1366 microversion: 2.1 time: 0.157972 Jun 15 14:57:03.845707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 478/974] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:03 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:04.862141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-da27b096-f797-4a04-b88e-6a279de64c5c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:04.862756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-da27b096-f797-4a04-b88e-6a279de64c5c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:04.864666 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:04.870816 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-da27b096-f797-4a04-b88e-6a279de64c5c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:04.871298 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-da27b096-f797-4a04-b88e-6a279de64c5c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:04.872057 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-da27b096-f797-4a04-b88e-6a279de64c5c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:04.872498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-da27b096-f797-4a04-b88e-6a279de64c5c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:05.000680 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-da27b096-f797-4a04-b88e-6a279de64c5c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:05.008098 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-da27b096-f797-4a04-b88e-6a279de64c5c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1555 microversion: 2.1 time: 0.150359 Jun 15 14:57:05.008658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 497/975] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:04 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:05.023965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-172aa504-a113-4a2d-8b57-4d9e0d90633a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:05.024486 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-172aa504-a113-4a2d-8b57-4d9e0d90633a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:05.030887 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-172aa504-a113-4a2d-8b57-4d9e0d90633a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:05.031369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-172aa504-a113-4a2d-8b57-4d9e0d90633a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:05.032139 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-172aa504-a113-4a2d-8b57-4d9e0d90633a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:05.032577 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-172aa504-a113-4a2d-8b57-4d9e0d90633a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:05.106754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-172aa504-a113-4a2d-8b57-4d9e0d90633a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086606 Jun 15 14:57:05.107376 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 479/976] 10.222.0.45 () {58 vars in 1274 bytes} [Wed Jun 15 14:57:05 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:57:06.248715 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-11a0b192-9a8e-45b0-81bf-bd2f23a97a58 req-952c50f8-5687-46b3-8046-90b1608989a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a004c55f-00c1-4c52-9103-f7c287937cd3", "tag": "ba1574e7-ba99-4ca7-b4b1-6814c0c45aa7"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:06.257602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-11a0b192-9a8e-45b0-81bf-bd2f23a97a58 req-952c50f8-5687-46b3-8046-90b1608989a6 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:06.258129 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-11a0b192-9a8e-45b0-81bf-bd2f23a97a58 req-952c50f8-5687-46b3-8046-90b1608989a6 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:06.270250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-11a0b192-9a8e-45b0-81bf-bd2f23a97a58 req-952c50f8-5687-46b3-8046-90b1608989a6 service nova] Creating event network-changed:ba1574e7-ba99-4ca7-b4b1-6814c0c45aa7 for instance a004c55f-00c1-4c52-9103-f7c287937cd3 on hv-cinder-80382 Jun 15 14:57:06.275784 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-11a0b192-9a8e-45b0-81bf-bd2f23a97a58 req-952c50f8-5687-46b3-8046-90b1608989a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031226 Jun 15 14:57:06.276570 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 498/977] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:57:54.085602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:54.086372 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:54.090214 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0c83ffc4-59a3-4b73-bf1a-52613a94e334 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:54.090733 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0c83ffc4-59a3-4b73-bf1a-52613a94e334 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:54.098022 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c83ffc4-59a3-4b73-bf1a-52613a94e334 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:54.098463 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c83ffc4-59a3-4b73-bf1a-52613a94e334 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:54.099252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c83ffc4-59a3-4b73-bf1a-52613a94e334 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:54.099682 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c83ffc4-59a3-4b73-bf1a-52613a94e334 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:54.125361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0c83ffc4-59a3-4b73-bf1a-52613a94e334 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:57:54.198738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0c83ffc4-59a3-4b73-bf1a-52613a94e334 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 204 len: 0 microversion: 2.1 time: 0.114320 Jun 15 14:57:54.199472 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 480/978] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:57:54 2022] DELETE /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:57:54.206113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6ef587a3-ad88-4dc3-b179-8275858a1ca3] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 14:57:54.206807 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:54.207604 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=38 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:54.212006 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-bacd4f14-69bd-4f8c-bb41-a8b80f56d2c5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:54.212699 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bacd4f14-69bd-4f8c-bb41-a8b80f56d2c5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:54.220601 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bacd4f14-69bd-4f8c-bb41-a8b80f56d2c5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:54.221051 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bacd4f14-69bd-4f8c-bb41-a8b80f56d2c5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:54.221815 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bacd4f14-69bd-4f8c-bb41-a8b80f56d2c5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:54.222251 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bacd4f14-69bd-4f8c-bb41-a8b80f56d2c5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:54.351191 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bacd4f14-69bd-4f8c-bb41-a8b80f56d2c5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:54.359231 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-bacd4f14-69bd-4f8c-bb41-a8b80f56d2c5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1576 microversion: 2.1 time: 0.154570 Jun 15 14:57:54.359806 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 499/979] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:54 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:55.378922 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5fb3d519-c6b3-4d6b-9cf8-50f0f60049b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:55.380789 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5fb3d519-c6b3-4d6b-9cf8-50f0f60049b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:55.391522 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5fb3d519-c6b3-4d6b-9cf8-50f0f60049b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:55.391962 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5fb3d519-c6b3-4d6b-9cf8-50f0f60049b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:55.392725 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5fb3d519-c6b3-4d6b-9cf8-50f0f60049b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:55.393184 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5fb3d519-c6b3-4d6b-9cf8-50f0f60049b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:55.553911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5fb3d519-c6b3-4d6b-9cf8-50f0f60049b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:55.562973 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5fb3d519-c6b3-4d6b-9cf8-50f0f60049b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1576 microversion: 2.1 time: 0.190217 Jun 15 14:57:55.563559 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 481/980] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:55 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:56.580877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-aa93bf74-7c34-45f0-b3a1-ab128f9e6f25 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:56.581495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-aa93bf74-7c34-45f0-b3a1-ab128f9e6f25 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:56.589206 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aa93bf74-7c34-45f0-b3a1-ab128f9e6f25 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:56.589659 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aa93bf74-7c34-45f0-b3a1-ab128f9e6f25 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:56.590446 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aa93bf74-7c34-45f0-b3a1-ab128f9e6f25 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:56.590882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aa93bf74-7c34-45f0-b3a1-ab128f9e6f25 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:56.608576 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] [6ef587a3-ad88-4dc3-b179-8275858a1ca3] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 56064. Jun 15 14:57:56.725856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-aa93bf74-7c34-45f0-b3a1-ab128f9e6f25 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:56.733602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-aa93bf74-7c34-45f0-b3a1-ab128f9e6f25 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1576 microversion: 2.1 time: 0.157113 Jun 15 14:57:56.734168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 500/981] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:56 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:57.266144 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-7d781f56-4960-4af5-bc89-b160dd3a1a19 req-152f24ab-94d0-44e3-a2c0-1f3a60314903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c62c5ab-613d-4a52-95e0-7ffe043a9628", "name": "network-vif-deleted", "tag": "62922aed-bb0a-4def-8adc-0a60c9968f87"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:57.275846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7d781f56-4960-4af5-bc89-b160dd3a1a19 req-152f24ab-94d0-44e3-a2c0-1f3a60314903 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.276374 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7d781f56-4960-4af5-bc89-b160dd3a1a19 req-152f24ab-94d0-44e3-a2c0-1f3a60314903 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:57.288074 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-7d781f56-4960-4af5-bc89-b160dd3a1a19 req-152f24ab-94d0-44e3-a2c0-1f3a60314903 service nova] Creating event network-vif-deleted:62922aed-bb0a-4def-8adc-0a60c9968f87 for instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 on hv-cinder-80382 Jun 15 14:57:57.294919 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-7d781f56-4960-4af5-bc89-b160dd3a1a19 req-152f24ab-94d0-44e3-a2c0-1f3a60314903 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 Jun 15 14:57:57.296199 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 482/982] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:57:57.751754 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:57.752365 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:57.759663 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.760119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:57.761145 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.761832 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:57.794214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.794667 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:57.795144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lazy-loading 'fault' on Instance uuid 7c62c5ab-613d-4a52-95e0-7ffe043a9628 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:57:57.838582 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:57.846186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0a576b4d-8376-4264-b802-d890f59d85c1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 200 len: 1229 microversion: 2.1 time: 0.099128 Jun 15 14:57:57.846757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 501/983] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:57 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:58.402755 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:57:58.403291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 14:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:57:58.863965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:58.864654 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:58.870859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.871332 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.872084 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.872515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.885516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] HTTP exception thrown: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Request method failure captured: Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 HTTP/1.1 Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfKU6wJG9wLonzIApYlNgPd8U2hVvoY2Ys869KCrlEG27Mb5NxXDaYaBHGb0e-zTgS9a9pNzNAMmCTYb-A1SjZhm1NmOvaq6mfk7DLzYJwTBNrqKdBsbBUkXgUUY0tasNmUDwePi1IA1bTBY0GgMO3jUv95ficNV1Jv_H72UmBZitCM Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:57:58.887128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestVolumeBootPattern-2042380299 Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-TestVolumeBootPattern-2042380299-project Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1b23fa0b7fdb4016917987ea1c40af33 Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestVolumeBootPattern-2042380299-project Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 14:57:58.888791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '7c62c5ab-613d-4a52-95e0-7ffe043a9628'} Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:57:58.890227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 14:57:58.891857 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:57:58.893262 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Returning 404 to user: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:57:58.893262 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3be7bade-87d0-49d7-a08d-012521ff5160 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 404 len: 111 microversion: 2.1 time: 0.029369 Jun 15 14:57:58.893262 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 483/984] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:58 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:57:59.033185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-993101323", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-35110241", "security_groups": [{"name": "tempest-secgroup-smoke-1779386159"}], "block_device_mapping_v2": [{"uuid": "afe920ec-1358-497e-b614-f75778f555fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3df4bca9-703b-4106-bc35-604acde24861"}]}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:59.142867 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] validate_networks() for [('3df4bca9-703b-4106-bc35-604acde24861', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:57:59.217348 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:57:59.217573 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Wed Jun 15 14:57:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Jun 15 14:57:59.510629 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:57:59.511078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:57:59.511554 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:57:59.511963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:57:59.512373 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:57:59.521251 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:59.521696 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:59.522490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:59.522925 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:59.539145 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Getting quotas for project 59120b6715c1485db0cb1277a52e6c55. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:57:59.543308 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Getting quotas for user 1b23fa0b7fdb4016917987ea1c40af33 and project 59120b6715c1485db0cb1277a52e6c55. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:57:59.598982 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:57:59.601069 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afe920ec-1358-497e-b614-f75778f555fc',volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:57:59.727641 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-44e4d9ab-10a0-4b17-adb9-025c49326e08 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698950 Jun 15 14:57:59.728292 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 502/985] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:57:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:57:59.738751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b836084a-6a43-402b-84dc-b84115454f4e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:59.739968 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b836084a-6a43-402b-84dc-b84115454f4e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:59.794927 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b836084a-6a43-402b-84dc-b84115454f4e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:59.802308 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b836084a-6a43-402b-84dc-b84115454f4e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1092 microversion: 2.1 time: 0.067326 Jun 15 14:57:59.802873 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 484/986] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:59 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1092 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:00.819271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-03d33b82-0b10-4be5-85ae-6c2f58c9123d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:00.819901 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-03d33b82-0b10-4be5-85ae-6c2f58c9123d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:00.827282 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03d33b82-0b10-4be5-85ae-6c2f58c9123d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.828602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03d33b82-0b10-4be5-85ae-6c2f58c9123d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.830287 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03d33b82-0b10-4be5-85ae-6c2f58c9123d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.831113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-03d33b82-0b10-4be5-85ae-6c2f58c9123d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.892992 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-03d33b82-0b10-4be5-85ae-6c2f58c9123d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:00.900489 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-03d33b82-0b10-4be5-85ae-6c2f58c9123d tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1208 microversion: 2.1 time: 0.085304 Jun 15 14:58:00.901061 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 503/987] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:00 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:01.917880 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-977d1c57-3ef5-43b8-a89b-ed2a5429af01 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:01.918494 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-977d1c57-3ef5-43b8-a89b-ed2a5429af01 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:01.925735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-977d1c57-3ef5-43b8-a89b-ed2a5429af01 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.926183 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-977d1c57-3ef5-43b8-a89b-ed2a5429af01 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:01.926961 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-977d1c57-3ef5-43b8-a89b-ed2a5429af01 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.927417 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-977d1c57-3ef5-43b8-a89b-ed2a5429af01 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.080830 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-977d1c57-3ef5-43b8-a89b-ed2a5429af01 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:02.089950 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-977d1c57-3ef5-43b8-a89b-ed2a5429af01 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.176100 Jun 15 14:58:02.092250 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 485/988] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:01 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:02.152189 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-327e65f6-275e-4c0e-9d7c-f2d187138b76 req-ce8a0374-8964-445b-9488-f518bbc969e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bd87db-4ebd-4703-9ee4-cc662692a9f0", "tag": "582cb652-e0a0-410c-85d7-5df2746fb9d3"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:02.162869 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-327e65f6-275e-4c0e-9d7c-f2d187138b76 req-ce8a0374-8964-445b-9488-f518bbc969e7 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:02.163606 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-327e65f6-275e-4c0e-9d7c-f2d187138b76 req-ce8a0374-8964-445b-9488-f518bbc969e7 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.177838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-327e65f6-275e-4c0e-9d7c-f2d187138b76 req-ce8a0374-8964-445b-9488-f518bbc969e7 service nova] Creating event network-changed:582cb652-e0a0-410c-85d7-5df2746fb9d3 for instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 on hv-cinder-80382 Jun 15 14:58:02.183380 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-327e65f6-275e-4c0e-9d7c-f2d187138b76 req-ce8a0374-8964-445b-9488-f518bbc969e7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034926 Jun 15 14:58:02.184219 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 504/989] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:03.108190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2dcca79d-bdce-43da-8e32-eac2ea5f3829 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:03.108862 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2dcca79d-bdce-43da-8e32-eac2ea5f3829 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:03.116359 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2dcca79d-bdce-43da-8e32-eac2ea5f3829 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.116803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2dcca79d-bdce-43da-8e32-eac2ea5f3829 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.117561 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2dcca79d-bdce-43da-8e32-eac2ea5f3829 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.117987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2dcca79d-bdce-43da-8e32-eac2ea5f3829 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.255512 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2dcca79d-bdce-43da-8e32-eac2ea5f3829 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:03.263122 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2dcca79d-bdce-43da-8e32-eac2ea5f3829 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.158789 Jun 15 14:58:03.263691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 486/990] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:03 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:04.282475 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-33931d4e-edae-4305-9fe4-4c7c2053bd7b tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:04.283131 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-33931d4e-edae-4305-9fe4-4c7c2053bd7b tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:04.289366 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-33931d4e-edae-4305-9fe4-4c7c2053bd7b tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.289820 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-33931d4e-edae-4305-9fe4-4c7c2053bd7b tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.290583 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-33931d4e-edae-4305-9fe4-4c7c2053bd7b tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.291305 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-33931d4e-edae-4305-9fe4-4c7c2053bd7b tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.423520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-33931d4e-edae-4305-9fe4-4c7c2053bd7b tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:04.430889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-33931d4e-edae-4305-9fe4-4c7c2053bd7b tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.153820 Jun 15 14:58:04.431487 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 505/991] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:04 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:05.447974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a67725df-1cd0-4800-b251-94fc23233a4a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:05.448586 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a67725df-1cd0-4800-b251-94fc23233a4a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:05.456320 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a67725df-1cd0-4800-b251-94fc23233a4a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.456847 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a67725df-1cd0-4800-b251-94fc23233a4a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:05.457639 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a67725df-1cd0-4800-b251-94fc23233a4a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.458356 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a67725df-1cd0-4800-b251-94fc23233a4a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:05.585927 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a67725df-1cd0-4800-b251-94fc23233a4a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:05.593210 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a67725df-1cd0-4800-b251-94fc23233a4a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.149188 Jun 15 14:58:05.593760 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 487/992] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:05 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:06.609741 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2153a747-0521-414a-aa48-ab8fcda80c07 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:06.610352 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2153a747-0521-414a-aa48-ab8fcda80c07 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:06.616896 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2153a747-0521-414a-aa48-ab8fcda80c07 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.617317 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2153a747-0521-414a-aa48-ab8fcda80c07 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.618076 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2153a747-0521-414a-aa48-ab8fcda80c07 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.618513 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2153a747-0521-414a-aa48-ab8fcda80c07 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.749039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2153a747-0521-414a-aa48-ab8fcda80c07 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:06.758010 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2153a747-0521-414a-aa48-ab8fcda80c07 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.152192 Jun 15 14:58:06.758573 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 506/993] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:06 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:07.774801 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d9769ce7-92f8-4fd6-9893-c78197611937 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:07.775442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d9769ce7-92f8-4fd6-9893-c78197611937 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:07.782670 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9769ce7-92f8-4fd6-9893-c78197611937 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.783136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9769ce7-92f8-4fd6-9893-c78197611937 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.783923 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9769ce7-92f8-4fd6-9893-c78197611937 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.784353 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9769ce7-92f8-4fd6-9893-c78197611937 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.914782 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d9769ce7-92f8-4fd6-9893-c78197611937 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.922390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d9769ce7-92f8-4fd6-9893-c78197611937 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.151439 Jun 15 14:58:07.922938 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 488/994] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:07 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:08.938747 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b783a563-d32c-47c1-9ed8-e779c3af9d61 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:08.939392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b783a563-d32c-47c1-9ed8-e779c3af9d61 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:08.945922 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b783a563-d32c-47c1-9ed8-e779c3af9d61 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.946377 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b783a563-d32c-47c1-9ed8-e779c3af9d61 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.947177 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b783a563-d32c-47c1-9ed8-e779c3af9d61 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.947620 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b783a563-d32c-47c1-9ed8-e779c3af9d61 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.074603 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b783a563-d32c-47c1-9ed8-e779c3af9d61 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:09.082645 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b783a563-d32c-47c1-9ed8-e779c3af9d61 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.148276 Jun 15 14:58:09.083242 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 507/995] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:08 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:10.099640 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b1ed07f7-2fe6-47e5-9b9d-f114ace333e3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:10.100446 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b1ed07f7-2fe6-47e5-9b9d-f114ace333e3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:10.102635 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:10.108286 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1ed07f7-2fe6-47e5-9b9d-f114ace333e3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:10.108730 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1ed07f7-2fe6-47e5-9b9d-f114ace333e3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:10.109488 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1ed07f7-2fe6-47e5-9b9d-f114ace333e3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:10.109946 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1ed07f7-2fe6-47e5-9b9d-f114ace333e3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:10.238750 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b1ed07f7-2fe6-47e5-9b9d-f114ace333e3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:10.246231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b1ed07f7-2fe6-47e5-9b9d-f114ace333e3 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.150588 Jun 15 14:58:10.246793 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 489/996] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:10 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:11.262230 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-7ed51541-206d-4c2a-bed7-4ca2b41de46a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:11.262838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-7ed51541-206d-4c2a-bed7-4ca2b41de46a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:11.264835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:11.265486 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:11.272187 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7ed51541-206d-4c2a-bed7-4ca2b41de46a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.272575 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7ed51541-206d-4c2a-bed7-4ca2b41de46a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.273347 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7ed51541-206d-4c2a-bed7-4ca2b41de46a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.273781 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-7ed51541-206d-4c2a-bed7-4ca2b41de46a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.401622 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-7ed51541-206d-4c2a-bed7-4ca2b41de46a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:11.411569 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-7ed51541-206d-4c2a-bed7-4ca2b41de46a tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.153012 Jun 15 14:58:11.412477 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 508/997] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:11 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:12.429374 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f9932071-c9bb-4127-b00e-fa500634ebe8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:12.429989 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f9932071-c9bb-4127-b00e-fa500634ebe8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:12.437210 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9932071-c9bb-4127-b00e-fa500634ebe8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:12.437692 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9932071-c9bb-4127-b00e-fa500634ebe8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:12.439533 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9932071-c9bb-4127-b00e-fa500634ebe8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:12.440262 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9932071-c9bb-4127-b00e-fa500634ebe8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:12.549827 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-29f2a945-6b58-4db3-a2a3-0ae70afb68d8 req-53a00849-1cdb-4eb1-9deb-23ff6b673be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bd87db-4ebd-4703-9ee4-cc662692a9f0", "name": "network-vif-plugged", "status": "completed", "tag": "582cb652-e0a0-410c-85d7-5df2746fb9d3"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:12.558748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-29f2a945-6b58-4db3-a2a3-0ae70afb68d8 req-53a00849-1cdb-4eb1-9deb-23ff6b673be8 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:12.559250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-29f2a945-6b58-4db3-a2a3-0ae70afb68d8 req-53a00849-1cdb-4eb1-9deb-23ff6b673be8 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:12.571414 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-29f2a945-6b58-4db3-a2a3-0ae70afb68d8 req-53a00849-1cdb-4eb1-9deb-23ff6b673be8 service nova] Creating event network-vif-plugged:582cb652-e0a0-410c-85d7-5df2746fb9d3 for instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 on hv-cinder-80382 Jun 15 14:58:12.578670 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f9932071-c9bb-4127-b00e-fa500634ebe8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:12.580820 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-29f2a945-6b58-4db3-a2a3-0ae70afb68d8 req-53a00849-1cdb-4eb1-9deb-23ff6b673be8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035293 Jun 15 14:58:12.581588 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 509/998] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:12.586830 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f9932071-c9bb-4127-b00e-fa500634ebe8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.161507 Jun 15 14:58:12.587449 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 490/999] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:12 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:13.604838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ab978858-67b0-49d1-80f6-6177d3a1bf75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:13.605545 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ab978858-67b0-49d1-80f6-6177d3a1bf75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:13.611770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ab978858-67b0-49d1-80f6-6177d3a1bf75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.612215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ab978858-67b0-49d1-80f6-6177d3a1bf75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.612961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ab978858-67b0-49d1-80f6-6177d3a1bf75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.613389 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ab978858-67b0-49d1-80f6-6177d3a1bf75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.744384 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ab978858-67b0-49d1-80f6-6177d3a1bf75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:13.752977 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ab978858-67b0-49d1-80f6-6177d3a1bf75 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.152738 Jun 15 14:58:13.753547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 510/1000] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:13 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:14.769381 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-af90ff32-a8bd-4339-9af9-4dcead73ce68 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:14.769991 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-af90ff32-a8bd-4339-9af9-4dcead73ce68 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:14.778044 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af90ff32-a8bd-4339-9af9-4dcead73ce68 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.778838 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af90ff32-a8bd-4339-9af9-4dcead73ce68 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.780282 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af90ff32-a8bd-4339-9af9-4dcead73ce68 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.780828 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af90ff32-a8bd-4339-9af9-4dcead73ce68 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.907987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-af90ff32-a8bd-4339-9af9-4dcead73ce68 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:14.915351 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-af90ff32-a8bd-4339-9af9-4dcead73ce68 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1264 microversion: 2.1 time: 0.149959 Jun 15 14:58:14.915904 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 491/1001] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:14 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:15.932750 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-230bc9ce-3c81-4a41-8f0d-9f9fe0b54a54 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:15.933360 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-230bc9ce-3c81-4a41-8f0d-9f9fe0b54a54 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:15.940500 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-230bc9ce-3c81-4a41-8f0d-9f9fe0b54a54 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.940957 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-230bc9ce-3c81-4a41-8f0d-9f9fe0b54a54 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.941713 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-230bc9ce-3c81-4a41-8f0d-9f9fe0b54a54 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.942148 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-230bc9ce-3c81-4a41-8f0d-9f9fe0b54a54 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.073492 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-230bc9ce-3c81-4a41-8f0d-9f9fe0b54a54 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:16.080990 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-230bc9ce-3c81-4a41-8f0d-9f9fe0b54a54 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1451 microversion: 2.1 time: 0.152152 Jun 15 14:58:16.081556 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 511/1002] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:15 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:16.096801 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a02c9a80-bb1a-4925-89e9-36fcbd5c4940 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:16.097451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a02c9a80-bb1a-4925-89e9-36fcbd5c4940 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:16.104036 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a02c9a80-bb1a-4925-89e9-36fcbd5c4940 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.104492 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a02c9a80-bb1a-4925-89e9-36fcbd5c4940 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.105267 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a02c9a80-bb1a-4925-89e9-36fcbd5c4940 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.105707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a02c9a80-bb1a-4925-89e9-36fcbd5c4940 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.233260 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a02c9a80-bb1a-4925-89e9-36fcbd5c4940 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:16.244610 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a02c9a80-bb1a-4925-89e9-36fcbd5c4940 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1451 microversion: 2.1 time: 0.150986 Jun 15 14:58:16.246621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 492/1003] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:16 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:18.025307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-838c6476-07c4-4ad6-aa29-e1e1ff9dd7f7 req-41e52959-24eb-464c-855a-7dc2fead8891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bd87db-4ebd-4703-9ee4-cc662692a9f0", "tag": "582cb652-e0a0-410c-85d7-5df2746fb9d3"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:18.034445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-838c6476-07c4-4ad6-aa29-e1e1ff9dd7f7 req-41e52959-24eb-464c-855a-7dc2fead8891 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.034974 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-838c6476-07c4-4ad6-aa29-e1e1ff9dd7f7 req-41e52959-24eb-464c-855a-7dc2fead8891 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.047229 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-838c6476-07c4-4ad6-aa29-e1e1ff9dd7f7 req-41e52959-24eb-464c-855a-7dc2fead8891 service nova] Creating event network-changed:582cb652-e0a0-410c-85d7-5df2746fb9d3 for instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 on hv-cinder-80382 Jun 15 14:58:18.052661 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-838c6476-07c4-4ad6-aa29-e1e1ff9dd7f7 req-41e52959-24eb-464c-855a-7dc2fead8891 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030861 Jun 15 14:58:18.053468 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 512/1004] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:21.329289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-31f7a9dd-d32b-4743-8ef7-b1a7c75178e5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:21.329820 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-31f7a9dd-d32b-4743-8ef7-b1a7c75178e5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.336358 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31f7a9dd-d32b-4743-8ef7-b1a7c75178e5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.336803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31f7a9dd-d32b-4743-8ef7-b1a7c75178e5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.337571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31f7a9dd-d32b-4743-8ef7-b1a7c75178e5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.338007 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31f7a9dd-d32b-4743-8ef7-b1a7c75178e5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.362621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-31f7a9dd-d32b-4743-8ef7-b1a7c75178e5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3/ips" status: 200 len: 149 microversion: 2.1 time: 0.037291 Jun 15 14:58:21.363193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 493/1005] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 14:58:21 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:21.374784 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aadb4c62-b7d3-46c1-b632-3d10aa79e4d3"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:21.376564 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.382734 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.383218 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.383981 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.384435 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.461654 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Invalid volume: volume aadb4c62-b7d3-46c1-b632-3d10aa79e4d3 is already attached to instances: 7ab621e7-097d-4967-b97e-713c90996caf Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: POST /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3/os-volume_attachments HTTP/1.1 Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 74 Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:58:21.463423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {"volumeAttachment": {"volumeId": "aadb4c62-b7d3-46c1-b632-3d10aa79e4d3"}} Jun 15 14:58:21.465151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Invalid volume: volume aadb4c62-b7d3-46c1-b632-3d10aa79e4d3 is already attached to instances: 7ab621e7-097d-4967-b97e-713c90996caf Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'server_id': 'a004c55f-00c1-4c52-9103-f7c287937cd3', 'body': {'volumeAttachment': {'volumeId': 'aadb4c62-b7d3-46c1-b632-3d10aa79e4d3'}}} Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aadb4c62-b7d3-46c1-b632-3d10aa79e4d3 is already attached to instances: 7ab621e7-097d-4967-b97e-713c90996caf Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:21.466214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aadb4c62-b7d3-46c1-b632-3d10aa79e4d3 is already attached to instances: 7ab621e7-097d-4967-b97e-713c90996caf Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:21.467612 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:21.469330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:21.469330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:21.469330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:21.469330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aadb4c62-b7d3-46c1-b632-3d10aa79e4d3 is already attached to instances: 7ab621e7-097d-4967-b97e-713c90996caf Jun 15 14:58:21.469330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:21.469330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 400 to user: Invalid volume: volume aadb4c62-b7d3-46c1-b632-3d10aa79e4d3 is already attached to instances: 7ab621e7-097d-4967-b97e-713c90996caf {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:21.469330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-61b4b777-8802-447b-9b83-f5e413684bd5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095117 Jun 15 14:58:21.469330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 513/1006] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 14:58:21 2022] POST /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:58:21.473661 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-993d6093-143e-4c86-8e12-43f5b91b50bf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:21.474156 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-993d6093-143e-4c86-8e12-43f5b91b50bf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.480127 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-993d6093-143e-4c86-8e12-43f5b91b50bf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.480571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-993d6093-143e-4c86-8e12-43f5b91b50bf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.481322 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-993d6093-143e-4c86-8e12-43f5b91b50bf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.481747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-993d6093-143e-4c86-8e12-43f5b91b50bf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.508998 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-993d6093-143e-4c86-8e12-43f5b91b50bf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:58:21.586122 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-993d6093-143e-4c86-8e12-43f5b91b50bf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 204 len: 0 microversion: 2.1 time: 0.116013 Jun 15 14:58:21.586725 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 494/1007] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:58:21 2022] DELETE /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:58:21.595372 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-04d3719a-fd6a-4f25-9352-a16f75f482af tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:21.595982 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-04d3719a-fd6a-4f25-9352-a16f75f482af tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.602770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-04d3719a-fd6a-4f25-9352-a16f75f482af tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.603253 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-04d3719a-fd6a-4f25-9352-a16f75f482af tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.604017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-04d3719a-fd6a-4f25-9352-a16f75f482af tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.604455 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-04d3719a-fd6a-4f25-9352-a16f75f482af tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.732004 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-04d3719a-fd6a-4f25-9352-a16f75f482af tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.740111 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-04d3719a-fd6a-4f25-9352-a16f75f482af tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1680 microversion: 2.1 time: 0.149109 Jun 15 14:58:21.740671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 514/1008] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:21 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:22.758534 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b5ada511-0073-4aaa-bb68-18b2468a0e9f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:22.759276 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b5ada511-0073-4aaa-bb68-18b2468a0e9f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:22.765847 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b5ada511-0073-4aaa-bb68-18b2468a0e9f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.766796 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b5ada511-0073-4aaa-bb68-18b2468a0e9f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.767595 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b5ada511-0073-4aaa-bb68-18b2468a0e9f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.768033 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b5ada511-0073-4aaa-bb68-18b2468a0e9f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.019153 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b5ada511-0073-4aaa-bb68-18b2468a0e9f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:23.022677 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:23.027579 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b5ada511-0073-4aaa-bb68-18b2468a0e9f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1680 microversion: 2.1 time: 0.273293 Jun 15 14:58:23.028146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 495/1009] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:22 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1680 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:24.045732 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9dbdff25-8176-4233-9deb-73eeb920ac27 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:24.046395 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9dbdff25-8176-4233-9deb-73eeb920ac27 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:24.053561 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9dbdff25-8176-4233-9deb-73eeb920ac27 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.054003 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9dbdff25-8176-4233-9deb-73eeb920ac27 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.054757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9dbdff25-8176-4233-9deb-73eeb920ac27 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.055234 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9dbdff25-8176-4233-9deb-73eeb920ac27 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.187448 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9dbdff25-8176-4233-9deb-73eeb920ac27 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.196210 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9dbdff25-8176-4233-9deb-73eeb920ac27 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1680 microversion: 2.1 time: 0.154589 Jun 15 14:58:24.196852 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 515/1010] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:24 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:24.778406 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-bb94a268-1a0d-4512-881c-4e3142a4645c req-0ee311f2-0b58-439b-9401-beb1a2176323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a004c55f-00c1-4c52-9103-f7c287937cd3", "name": "network-vif-deleted", "tag": "ba1574e7-ba99-4ca7-b4b1-6814c0c45aa7"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:24.783170 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:24.791591 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-bb94a268-1a0d-4512-881c-4e3142a4645c req-0ee311f2-0b58-439b-9401-beb1a2176323 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.792030 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-bb94a268-1a0d-4512-881c-4e3142a4645c req-0ee311f2-0b58-439b-9401-beb1a2176323 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.805936 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-bb94a268-1a0d-4512-881c-4e3142a4645c req-0ee311f2-0b58-439b-9401-beb1a2176323 service nova] Creating event network-vif-deleted:ba1574e7-ba99-4ca7-b4b1-6814c0c45aa7 for instance a004c55f-00c1-4c52-9103-f7c287937cd3 on hv-cinder-80382 Jun 15 14:58:24.811895 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-bb94a268-1a0d-4512-881c-4e3142a4645c req-0ee311f2-0b58-439b-9401-beb1a2176323 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037292 Jun 15 14:58:24.812506 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 496/1011] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:25.213781 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:25.214627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:25.217133 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:25.223306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.223751 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.224522 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.224958 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.228624 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=89 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:25.259573 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.260023 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.260478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lazy-loading 'fault' on Instance uuid a004c55f-00c1-4c52-9103-f7c287937cd3 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:25.305964 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:25.314483 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cd1cb76e-44d0-47d8-baf3-43737ed2c885 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 200 len: 1331 microversion: 2.1 time: 0.104566 Jun 15 14:58:25.315337 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 516/1012] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:25 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:26.333174 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:26.333872 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:26.340106 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.340558 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.341319 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.341752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.354664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 HTTP/1.1 Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 14:58:26.356284 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 14:58:26.357903 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'a004c55f-00c1-4c52-9103-f7c287937cd3'} Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:26.358987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 14:58:26.360516 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 14:58:26.362086 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:26.362086 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-338e95a0-0c55-478e-92ed-070c9b92da72 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 404 len: 111 microversion: 2.1 time: 0.029883 Jun 15 14:58:26.362086 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 497/1013] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:26 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:26.366423 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8cb69d19-b0f6-4fca-86c2-31e1ddcffb37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '.version_select at 0x7f05b77f4e50>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:26.383756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8cb69d19-b0f6-4fca-86c2-31e1ddcffb37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-983282135" status: 202 len: 0 microversion: 2.1 time: 0.021126 Jun 15 14:58:26.384295 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 517/1014] 10.222.0.45 () {58 vars in 1217 bytes} [Wed Jun 15 14:58:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-983282135 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:27.022923 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cd201e2d-ae64-4639-9761-178cdeb4a89f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:27.023447 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cd201e2d-ae64-4639-9761-178cdeb4a89f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:27.029365 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cd201e2d-ae64-4639-9761-178cdeb4a89f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:27.029804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cd201e2d-ae64-4639-9761-178cdeb4a89f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:27.030563 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cd201e2d-ae64-4639-9761-178cdeb4a89f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:27.031021 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cd201e2d-ae64-4639-9761-178cdeb4a89f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:27.110798 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-cd201e2d-ae64-4639-9761-178cdeb4a89f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lazy-loading 'services' on Instance uuid 7ab621e7-097d-4967-b97e-713c90996caf {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:27.181814 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cd201e2d-ae64-4639-9761-178cdeb4a89f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-volume_attachments/aadb4c62-b7d3-46c1-b632-3d10aa79e4d3" status: 202 len: 0 microversion: 2.1 time: 0.162767 Jun 15 14:58:27.182386 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 498/1015] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 14:58:27 2022] DELETE /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-volume_attachments/aadb4c62-b7d3-46c1-b632-3d10aa79e4d3 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:27.191022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a0f2c90f-f5c6-41ac-90b0-4e70deabf7d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:27.191972 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a0f2c90f-f5c6-41ac-90b0-4e70deabf7d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:27.198789 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0f2c90f-f5c6-41ac-90b0-4e70deabf7d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:27.199506 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0f2c90f-f5c6-41ac-90b0-4e70deabf7d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:27.200264 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0f2c90f-f5c6-41ac-90b0-4e70deabf7d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:27.200710 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a0f2c90f-f5c6-41ac-90b0-4e70deabf7d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:27.230809 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a0f2c90f-f5c6-41ac-90b0-4e70deabf7d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Jun 15 14:58:27.231403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 518/1016] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:58:27 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:28.242944 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-76a8a610-76d1-4a91-85c1-c399a7af0a98 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:28.244027 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-76a8a610-76d1-4a91-85c1-c399a7af0a98 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:28.250259 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-76a8a610-76d1-4a91-85c1-c399a7af0a98 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.251304 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-76a8a610-76d1-4a91-85c1-c399a7af0a98 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.252063 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-76a8a610-76d1-4a91-85c1-c399a7af0a98 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.252491 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-76a8a610-76d1-4a91-85c1-c399a7af0a98 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.280509 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-76a8a610-76d1-4a91-85c1-c399a7af0a98 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042274 Jun 15 14:58:28.281064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 499/1017] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 14:58:28 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:58:28.337021 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8141b1ad-791d-4341-b61f-006dde6b4be3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:28.337523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8141b1ad-791d-4341-b61f-006dde6b4be3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:28.343949 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8141b1ad-791d-4341-b61f-006dde6b4be3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.344915 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8141b1ad-791d-4341-b61f-006dde6b4be3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.345673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8141b1ad-791d-4341-b61f-006dde6b4be3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.346113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8141b1ad-791d-4341-b61f-006dde6b4be3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.372956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8141b1ad-791d-4341-b61f-006dde6b4be3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:58:28.445772 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8141b1ad-791d-4341-b61f-006dde6b4be3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 204 len: 0 microversion: 2.1 time: 0.112228 Jun 15 14:58:28.446436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 519/1018] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 14:58:28 2022] DELETE /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:58:28.455987 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e7265d88-45b8-4fad-b4b5-ac28738128ba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:28.456591 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e7265d88-45b8-4fad-b4b5-ac28738128ba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:28.462437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7265d88-45b8-4fad-b4b5-ac28738128ba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.462885 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7265d88-45b8-4fad-b4b5-ac28738128ba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.463750 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7265d88-45b8-4fad-b4b5-ac28738128ba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.464180 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7265d88-45b8-4fad-b4b5-ac28738128ba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.591227 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e7265d88-45b8-4fad-b4b5-ac28738128ba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.598846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e7265d88-45b8-4fad-b4b5-ac28738128ba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1678 microversion: 2.1 time: 0.147644 Jun 15 14:58:28.599438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 500/1019] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:28 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:29.615980 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-02cbaa58-2c90-432f-a29c-5d44cd971ce2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:29.616672 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-02cbaa58-2c90-432f-a29c-5d44cd971ce2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:29.623256 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-02cbaa58-2c90-432f-a29c-5d44cd971ce2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.623704 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-02cbaa58-2c90-432f-a29c-5d44cd971ce2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.624458 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-02cbaa58-2c90-432f-a29c-5d44cd971ce2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.624891 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-02cbaa58-2c90-432f-a29c-5d44cd971ce2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.755793 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-02cbaa58-2c90-432f-a29c-5d44cd971ce2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:29.763186 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-02cbaa58-2c90-432f-a29c-5d44cd971ce2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1678 microversion: 2.1 time: 0.151419 Jun 15 14:58:29.763746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 520/1020] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:29 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:30.780183 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fa007a98-91e4-4c56-bcc0-6bb8e6a00fdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:30.780808 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fa007a98-91e4-4c56-bcc0-6bb8e6a00fdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:30.787919 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa007a98-91e4-4c56-bcc0-6bb8e6a00fdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.788362 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa007a98-91e4-4c56-bcc0-6bb8e6a00fdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.789117 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa007a98-91e4-4c56-bcc0-6bb8e6a00fdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.789547 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa007a98-91e4-4c56-bcc0-6bb8e6a00fdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.921739 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fa007a98-91e4-4c56-bcc0-6bb8e6a00fdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:30.929843 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fa007a98-91e4-4c56-bcc0-6bb8e6a00fdf tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1678 microversion: 2.1 time: 0.153519 Jun 15 14:58:30.930418 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 501/1021] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:30 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:31.485551 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-bcc9c749-8bfa-4b01-8f38-4e72ae795deb req-4af7f023-778b-40b0-b99e-ead5639aba40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab621e7-097d-4967-b97e-713c90996caf", "name": "network-vif-deleted", "tag": "8963b9b8-5e1d-4373-ab84-11a26d38f437"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:31.495085 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-bcc9c749-8bfa-4b01-8f38-4e72ae795deb req-4af7f023-778b-40b0-b99e-ead5639aba40 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.495530 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-bcc9c749-8bfa-4b01-8f38-4e72ae795deb req-4af7f023-778b-40b0-b99e-ead5639aba40 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.508564 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-bcc9c749-8bfa-4b01-8f38-4e72ae795deb req-4af7f023-778b-40b0-b99e-ead5639aba40 service nova] Creating event network-vif-deleted:8963b9b8-5e1d-4373-ab84-11a26d38f437 for instance 7ab621e7-097d-4967-b97e-713c90996caf on hv-cinder-80382 Jun 15 14:58:31.513993 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-bcc9c749-8bfa-4b01-8f38-4e72ae795deb req-4af7f023-778b-40b0-b99e-ead5639aba40 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 Jun 15 14:58:31.514719 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 521/1022] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:31.948560 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.949177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.956390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.956923 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.957901 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.958336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.992310 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.992753 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.993218 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lazy-loading 'fault' on Instance uuid 7ab621e7-097d-4967-b97e-713c90996caf {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:32.036948 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.045705 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e10bb5e8-712c-4542-8c16-e5dec1279f0b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 200 len: 1331 microversion: 2.1 time: 0.102070 Jun 15 14:58:32.046606 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 502/1023] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:31 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:33.065245 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:33.065974 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:33.072209 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.072662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.073419 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.073854 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.087796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf HTTP/1.1 Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 14:58:33.089436 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 14:58:33.091060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '7ab621e7-097d-4967-b97e-713c90996caf'} Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:33.091970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 14:58:33.093504 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 14:58:33.094884 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:33.094884 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fbdfa686-5a04-480a-b100-1ea06fdcb4f1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 404 len: 111 microversion: 2.1 time: 0.030730 Jun 15 14:58:33.094884 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 522/1024] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:33 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:33.099691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7483179d-baa2-4571-82de-60ec3eeef1c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '.version_select at 0x7f05b765e790>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:33.120114 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7483179d-baa2-4571-82de-60ec3eeef1c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101857716" status: 202 len: 0 microversion: 2.1 time: 0.024249 Jun 15 14:58:33.120661 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 503/1025] 10.222.0.45 () {58 vars in 1220 bytes} [Wed Jun 15 14:58:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101857716 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:58:33.721215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-309fd89b-609f-45e0-a5b1-bcb8ffa837c7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: .version_select at 0x7f05bc0aa280>, body: {"keypair": {"name": "tempest-keypair-1882282095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpfeOILITV8+Yg8HnczHvDLGhmyzEytL1/YqRho1ChUE1MbYynRIeso63PcoF/DOAXpkTpk1imip1ZP9Fwxj8X+anziZRrruMSK1Liu0fwkyqJ7FbwHBVoSoAojfFOGYg=="}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:33.735159 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-309fd89b-609f-45e0-a5b1-bcb8ffa837c7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:33.738909 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-309fd89b-609f-45e0-a5b1-bcb8ffa837c7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for user 1f95ff4743414cbc8cc9a213e508113b and project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:33.760617 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-309fd89b-609f-45e0-a5b1-bcb8ffa837c7 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043398 Jun 15 14:58:33.761198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 523/1026] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 14:58:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:34.952866 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-537748010", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3fe8514-b139-4a79-925c-aad99761c6b3"}], "security_groups": [{"name": "tempest-securitygroup--1598163112"}], "key_name": "tempest-keypair-1882282095", "user_data": "}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:35.054281 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] validate_networks() for [('f3fe8514-b139-4a79-925c-aad99761c6b3', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:58:35.415241 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:58:35.415659 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:58:35.416132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:58:35.416833 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:58:35.417244 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:58:35.426706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.427188 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.427981 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.428408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.445128 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:35.448983 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for user 1f95ff4743414cbc8cc9a213e508113b and project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'cores', 'ram', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:35.459680 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:58:35.461883 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:58:35.507413 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9b10e023-259c-48ba-9fa8-123d7e860500 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.558730 Jun 15 14:58:35.508049 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 504/1027] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 14:58:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:58:35.518653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ee140054-734b-48b2-a15b-99d7b8300f25 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:35.519293 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ee140054-734b-48b2-a15b-99d7b8300f25 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:35.581155 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ee140054-734b-48b2-a15b-99d7b8300f25 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:35.587877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ee140054-734b-48b2-a15b-99d7b8300f25 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1241 microversion: 2.1 time: 0.073828 Jun 15 14:58:35.588520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 524/1028] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:35 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:36.604944 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4232eb91-3c10-42b5-be34-1ab7ea8ca030 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:36.605630 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4232eb91-3c10-42b5-be34-1ab7ea8ca030 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:36.612613 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4232eb91-3c10-42b5-be34-1ab7ea8ca030 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.613074 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4232eb91-3c10-42b5-be34-1ab7ea8ca030 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.613845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4232eb91-3c10-42b5-be34-1ab7ea8ca030 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.614453 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4232eb91-3c10-42b5-be34-1ab7ea8ca030 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.679389 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4232eb91-3c10-42b5-be34-1ab7ea8ca030 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:36.688666 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4232eb91-3c10-42b5-be34-1ab7ea8ca030 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1311 microversion: 2.1 time: 0.087583 Jun 15 14:58:36.689764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 505/1029] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:36 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:37.705856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-55b0f200-9131-4cbf-9123-6063ebcd33a6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:37.706533 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-55b0f200-9131-4cbf-9123-6063ebcd33a6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:37.713489 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-55b0f200-9131-4cbf-9123-6063ebcd33a6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.713931 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-55b0f200-9131-4cbf-9123-6063ebcd33a6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.714718 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-55b0f200-9131-4cbf-9123-6063ebcd33a6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.715184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-55b0f200-9131-4cbf-9123-6063ebcd33a6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.849380 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-55b0f200-9131-4cbf-9123-6063ebcd33a6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:37.856956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-55b0f200-9131-4cbf-9123-6063ebcd33a6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1367 microversion: 2.1 time: 0.155505 Jun 15 14:58:37.866887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 525/1030] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:37 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:38.070669 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-b57e8f70-bee3-4112-a5dc-7e7e51460694 req-6145fa83-daa5-42d4-a608-5f58876d36bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed6135e-cb3c-4138-9a5d-4125acba45d6", "tag": "fad1a14a-5696-4c0b-b016-af8964d273d1"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:38.080715 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-b57e8f70-bee3-4112-a5dc-7e7e51460694 req-6145fa83-daa5-42d4-a608-5f58876d36bf service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.081150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-b57e8f70-bee3-4112-a5dc-7e7e51460694 req-6145fa83-daa5-42d4-a608-5f58876d36bf service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.092995 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-b57e8f70-bee3-4112-a5dc-7e7e51460694 req-6145fa83-daa5-42d4-a608-5f58876d36bf service nova] Creating event network-changed:fad1a14a-5696-4c0b-b016-af8964d273d1 for instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 on hv-cinder-80382 Jun 15 14:58:38.100035 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-b57e8f70-bee3-4112-a5dc-7e7e51460694 req-6145fa83-daa5-42d4-a608-5f58876d36bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038767 Jun 15 14:58:38.101255 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 506/1031] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:38.874342 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-2aaf435f-3979-459c-b690-68a70d93984f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:38.874962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-2aaf435f-3979-459c-b690-68a70d93984f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:38.882123 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2aaf435f-3979-459c-b690-68a70d93984f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.882578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2aaf435f-3979-459c-b690-68a70d93984f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.883374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2aaf435f-3979-459c-b690-68a70d93984f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.883817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-2aaf435f-3979-459c-b690-68a70d93984f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.011287 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-2aaf435f-3979-459c-b690-68a70d93984f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:39.019296 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-2aaf435f-3979-459c-b690-68a70d93984f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1367 microversion: 2.1 time: 0.148789 Jun 15 14:58:39.019860 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 526/1032] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:38 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:40.036928 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-30dc4700-b6dc-4c20-bc93-3b7db68cfbf3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:40.037576 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-30dc4700-b6dc-4c20-bc93-3b7db68cfbf3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:40.044148 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-30dc4700-b6dc-4c20-bc93-3b7db68cfbf3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:40.044603 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-30dc4700-b6dc-4c20-bc93-3b7db68cfbf3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:40.045367 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-30dc4700-b6dc-4c20-bc93-3b7db68cfbf3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:40.045809 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-30dc4700-b6dc-4c20-bc93-3b7db68cfbf3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:40.173148 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-30dc4700-b6dc-4c20-bc93-3b7db68cfbf3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:40.180604 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-30dc4700-b6dc-4c20-bc93-3b7db68cfbf3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1367 microversion: 2.1 time: 0.148448 Jun 15 14:58:40.181167 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 507/1033] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:40 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:41.197851 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1f110e6e-7a94-48fb-bfc3-491a4a8f37ef tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:41.198477 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1f110e6e-7a94-48fb-bfc3-491a4a8f37ef tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:41.205735 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1f110e6e-7a94-48fb-bfc3-491a4a8f37ef tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.206184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1f110e6e-7a94-48fb-bfc3-491a4a8f37ef tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.207041 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1f110e6e-7a94-48fb-bfc3-491a4a8f37ef tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.207503 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1f110e6e-7a94-48fb-bfc3-491a4a8f37ef tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.337402 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1f110e6e-7a94-48fb-bfc3-491a4a8f37ef tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:41.344887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1f110e6e-7a94-48fb-bfc3-491a4a8f37ef tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1367 microversion: 2.1 time: 0.151019 Jun 15 14:58:41.345452 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 527/1034] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:41 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:42.361974 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-44229b0e-c361-4d52-b6f5-0e70012f25d8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:42.362599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-44229b0e-c361-4d52-b6f5-0e70012f25d8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:42.369245 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-44229b0e-c361-4d52-b6f5-0e70012f25d8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.369632 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-44229b0e-c361-4d52-b6f5-0e70012f25d8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:42.370398 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-44229b0e-c361-4d52-b6f5-0e70012f25d8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.370838 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-44229b0e-c361-4d52-b6f5-0e70012f25d8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:42.500746 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-44229b0e-c361-4d52-b6f5-0e70012f25d8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:42.508660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-44229b0e-c361-4d52-b6f5-0e70012f25d8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1367 microversion: 2.1 time: 0.151113 Jun 15 14:58:42.509215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 508/1035] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:42 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:43.525341 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-bee2d783-a48e-4645-bfea-dd9ac52f5e16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:43.525883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bee2d783-a48e-4645-bfea-dd9ac52f5e16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:43.532369 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bee2d783-a48e-4645-bfea-dd9ac52f5e16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.532818 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bee2d783-a48e-4645-bfea-dd9ac52f5e16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.533576 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bee2d783-a48e-4645-bfea-dd9ac52f5e16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.534013 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bee2d783-a48e-4645-bfea-dd9ac52f5e16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.663080 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bee2d783-a48e-4645-bfea-dd9ac52f5e16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:43.675802 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-bee2d783-a48e-4645-bfea-dd9ac52f5e16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1367 microversion: 2.1 time: 0.154472 Jun 15 14:58:43.676362 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 528/1036] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:43 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:44.683279 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-836a5033-d00c-4710-8899-d90b5e0f0a76 req-f534d823-2f4c-46f1-901a-ed80771048f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed6135e-cb3c-4138-9a5d-4125acba45d6", "name": "network-vif-plugged", "status": "completed", "tag": "fad1a14a-5696-4c0b-b016-af8964d273d1"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:44.692325 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-836a5033-d00c-4710-8899-d90b5e0f0a76 req-f534d823-2f4c-46f1-901a-ed80771048f4 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:44.692810 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-836a5033-d00c-4710-8899-d90b5e0f0a76 req-f534d823-2f4c-46f1-901a-ed80771048f4 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:44.693017 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8d1bed67-412f-4b9e-a293-c395cb4c796f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:44.695076 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8d1bed67-412f-4b9e-a293-c395cb4c796f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:44.706190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-836a5033-d00c-4710-8899-d90b5e0f0a76 req-f534d823-2f4c-46f1-901a-ed80771048f4 service nova] Creating event network-vif-plugged:fad1a14a-5696-4c0b-b016-af8964d273d1 for instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 on hv-cinder-80382 Jun 15 14:58:44.707205 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8d1bed67-412f-4b9e-a293-c395cb4c796f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:44.707672 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8d1bed67-412f-4b9e-a293-c395cb4c796f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:44.708462 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8d1bed67-412f-4b9e-a293-c395cb4c796f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:44.708896 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8d1bed67-412f-4b9e-a293-c395cb4c796f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:44.711456 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-836a5033-d00c-4710-8899-d90b5e0f0a76 req-f534d823-2f4c-46f1-901a-ed80771048f4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 Jun 15 14:58:44.712042 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 509/1037] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:44.848773 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8d1bed67-412f-4b9e-a293-c395cb4c796f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:44.856306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8d1bed67-412f-4b9e-a293-c395cb4c796f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1367 microversion: 2.1 time: 0.167768 Jun 15 14:58:44.856876 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 529/1038] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:44 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:45.869307 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:45.870076 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:45.874631 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3e71bb69-a192-46be-885d-45ff0008baf5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:45.875327 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3e71bb69-a192-46be-885d-45ff0008baf5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:45.882489 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3e71bb69-a192-46be-885d-45ff0008baf5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.882939 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3e71bb69-a192-46be-885d-45ff0008baf5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.883728 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3e71bb69-a192-46be-885d-45ff0008baf5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.884171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3e71bb69-a192-46be-885d-45ff0008baf5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.015395 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3e71bb69-a192-46be-885d-45ff0008baf5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:46.023216 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3e71bb69-a192-46be-885d-45ff0008baf5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1367 microversion: 2.1 time: 0.154816 Jun 15 14:58:46.023783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 510/1039] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:45 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:47.040574 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6e2ed240-60d7-4d45-9f2a-fa567e1f0bab tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:47.041207 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6e2ed240-60d7-4d45-9f2a-fa567e1f0bab tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:47.043310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:47.049680 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e2ed240-60d7-4d45-9f2a-fa567e1f0bab tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.050134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e2ed240-60d7-4d45-9f2a-fa567e1f0bab tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.050894 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e2ed240-60d7-4d45-9f2a-fa567e1f0bab tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.051355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6e2ed240-60d7-4d45-9f2a-fa567e1f0bab tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.179547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6e2ed240-60d7-4d45-9f2a-fa567e1f0bab tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:47.186879 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6e2ed240-60d7-4d45-9f2a-fa567e1f0bab tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1557 microversion: 2.1 time: 0.150235 Jun 15 14:58:47.187544 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 530/1040] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:47 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:47.202904 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d5b186b1-8869-4890-92b9-f59b8bfcf81f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:47.203441 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d5b186b1-8869-4890-92b9-f59b8bfcf81f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:47.209813 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d5b186b1-8869-4890-92b9-f59b8bfcf81f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.210257 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d5b186b1-8869-4890-92b9-f59b8bfcf81f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.211039 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d5b186b1-8869-4890-92b9-f59b8bfcf81f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.211478 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d5b186b1-8869-4890-92b9-f59b8bfcf81f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.286870 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d5b186b1-8869-4890-92b9-f59b8bfcf81f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087800 Jun 15 14:58:47.287470 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 511/1041] 10.222.0.45 () {58 vars in 1274 bytes} [Wed Jun 15 14:58:47 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:48.407685 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-0c6379fb-7e46-472d-bd7a-0ae6e94dd572 req-d83671aa-0aaa-45b8-96e5-9611378c4ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed6135e-cb3c-4138-9a5d-4125acba45d6", "tag": "fad1a14a-5696-4c0b-b016-af8964d273d1"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:48.416166 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-0c6379fb-7e46-472d-bd7a-0ae6e94dd572 req-d83671aa-0aaa-45b8-96e5-9611378c4ed5 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:48.417108 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-0c6379fb-7e46-472d-bd7a-0ae6e94dd572 req-d83671aa-0aaa-45b8-96e5-9611378c4ed5 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:48.427931 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-0c6379fb-7e46-472d-bd7a-0ae6e94dd572 req-d83671aa-0aaa-45b8-96e5-9611378c4ed5 service nova] Creating event network-changed:fad1a14a-5696-4c0b-b016-af8964d273d1 for instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 on hv-cinder-80382 Jun 15 14:58:48.433041 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-0c6379fb-7e46-472d-bd7a-0ae6e94dd572 req-d83671aa-0aaa-45b8-96e5-9611378c4ed5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029582 Jun 15 14:58:48.433662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 531/1042] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:15.258700 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2865efde-36bb-4be5-9af1-8067e1532964] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 15:00:15.259257 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:15.259999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:15.323427 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-800f43f9-1f1c-4bce-8b6b-f18adcdec2e0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:15.323956 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-800f43f9-1f1c-4bce-8b6b-f18adcdec2e0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:15.329967 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-800f43f9-1f1c-4bce-8b6b-f18adcdec2e0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.330415 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-800f43f9-1f1c-4bce-8b6b-f18adcdec2e0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.331204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-800f43f9-1f1c-4bce-8b6b-f18adcdec2e0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.331643 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-800f43f9-1f1c-4bce-8b6b-f18adcdec2e0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.354135 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-800f43f9-1f1c-4bce-8b6b-f18adcdec2e0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/ips" status: 200 len: 149 microversion: 2.1 time: 0.097112 Jun 15 15:00:15.354669 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 512/1043] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 15:00:15 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:20.634630 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:20.635385 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:20.639840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-564839989", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-35110241", "security_groups": [{"name": "tempest-secgroup-smoke-1779386159"}], "block_device_mapping_v2": [{"uuid": "47d83c23-9b94-4ad9-8fdb-4a84c0b5e863", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3df4bca9-703b-4106-bc35-604acde24861"}]}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:20.805014 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] validate_networks() for [('3df4bca9-703b-4106-bc35-604acde24861', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:00:20.843166 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5b9ade5b-03da-4aff-864d-4fcfe486a324 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bfe8e85-3c58-45bf-9872-c343597263ce"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:20.844510 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5b9ade5b-03da-4aff-864d-4fcfe486a324 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:20.854705 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b9ade5b-03da-4aff-864d-4fcfe486a324 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:20.855256 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b9ade5b-03da-4aff-864d-4fcfe486a324 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:20.856087 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b9ade5b-03da-4aff-864d-4fcfe486a324 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:20.856591 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b9ade5b-03da-4aff-864d-4fcfe486a324 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:20.862262 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] [2865efde-36bb-4be5-9af1-8067e1532964] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 56416. Jun 15 15:00:21.113689 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5b9ade5b-03da-4aff-864d-4fcfe486a324 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274356 Jun 15 15:00:21.114314 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 513/1044] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 15:00:20 2022] POST /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:21.237947 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:00:21.238391 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:00:21.238896 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:00:21.239355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:00:21.239766 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:00:21.248448 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:21.248897 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:21.249693 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:21.250127 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:21.267257 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Getting quotas for project 59120b6715c1485db0cb1277a52e6c55. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:00:21.271775 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Getting quotas for user 1b23fa0b7fdb4016917987ea1c40af33 and project 59120b6715c1485db0cb1277a52e6c55. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:00:21.506888 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:00:21.509478 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47d83c23-9b94-4ad9-8fdb-4a84c0b5e863',volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:00:21.635344 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f95d99d1-ed5b-47ce-98f4-4440fad17516 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.002629 Jun 15 15:00:21.639580 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 532/1045] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 15:00:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:00:21.648029 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-641e85ad-0ac6-4e3d-b8fd-1b2ad090959c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:21.648761 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-641e85ad-0ac6-4e3d-b8fd-1b2ad090959c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:21.704109 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-641e85ad-0ac6-4e3d-b8fd-1b2ad090959c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:21.712149 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-641e85ad-0ac6-4e3d-b8fd-1b2ad090959c tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1092 microversion: 2.1 time: 0.069941 Jun 15 15:00:21.713171 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 514/1046] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:21 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:22.730611 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ba0ad128-8332-4794-8d11-4413d9a4f561 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:22.731284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ba0ad128-8332-4794-8d11-4413d9a4f561 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:22.738215 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ba0ad128-8332-4794-8d11-4413d9a4f561 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.738663 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ba0ad128-8332-4794-8d11-4413d9a4f561 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.739476 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ba0ad128-8332-4794-8d11-4413d9a4f561 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.739914 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ba0ad128-8332-4794-8d11-4413d9a4f561 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.804059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ba0ad128-8332-4794-8d11-4413d9a4f561 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:22.811712 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ba0ad128-8332-4794-8d11-4413d9a4f561 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1208 microversion: 2.1 time: 0.085683 Jun 15 15:00:22.812390 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 533/1047] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:22 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1208 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:23.828599 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6393b410-c660-4184-8e37-59d16fcee977 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:23.829846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6393b410-c660-4184-8e37-59d16fcee977 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:23.837454 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6393b410-c660-4184-8e37-59d16fcee977 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.837919 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6393b410-c660-4184-8e37-59d16fcee977 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.838783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6393b410-c660-4184-8e37-59d16fcee977 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.839258 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6393b410-c660-4184-8e37-59d16fcee977 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.990264 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6393b410-c660-4184-8e37-59d16fcee977 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:23.998042 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6393b410-c660-4184-8e37-59d16fcee977 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1276 microversion: 2.1 time: 0.173913 Jun 15 15:00:23.998694 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 515/1048] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:23 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:24.099916 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-93110d30-7a99-43f2-beb4-56e5272c7690 req-1d9b89f2-1e92-495f-b284-ce38d7d93380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a517126-ffcc-4783-a8fa-933ac859bddc", "tag": "1bb24e2b-aca5-4f2e-b4c4-df1294f1257a"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:24.109414 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-93110d30-7a99-43f2-beb4-56e5272c7690 req-1d9b89f2-1e92-495f-b284-ce38d7d93380 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:24.110152 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-93110d30-7a99-43f2-beb4-56e5272c7690 req-1d9b89f2-1e92-495f-b284-ce38d7d93380 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:24.121758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-93110d30-7a99-43f2-beb4-56e5272c7690 req-1d9b89f2-1e92-495f-b284-ce38d7d93380 service nova] Creating event network-changed:1bb24e2b-aca5-4f2e-b4c4-df1294f1257a for instance 9a517126-ffcc-4783-a8fa-933ac859bddc on hv-cinder-80382 Jun 15 15:00:24.126966 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-93110d30-7a99-43f2-beb4-56e5272c7690 req-1d9b89f2-1e92-495f-b284-ce38d7d93380 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101072 Jun 15 15:00:24.127599 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 534/1049] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:25.014331 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fb7a98d2-25bd-47bb-9e66-7f029c51b2de tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:25.014945 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fb7a98d2-25bd-47bb-9e66-7f029c51b2de tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:25.021965 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb7a98d2-25bd-47bb-9e66-7f029c51b2de tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:25.022414 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb7a98d2-25bd-47bb-9e66-7f029c51b2de tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:25.023215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb7a98d2-25bd-47bb-9e66-7f029c51b2de tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:25.023653 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb7a98d2-25bd-47bb-9e66-7f029c51b2de tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:25.153112 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fb7a98d2-25bd-47bb-9e66-7f029c51b2de tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:25.160518 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fb7a98d2-25bd-47bb-9e66-7f029c51b2de tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1276 microversion: 2.1 time: 0.150178 Jun 15 15:00:25.161743 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 516/1050] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:25 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:26.179168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d7ed67b6-6d6c-468a-994e-391a4c261d8f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:26.179903 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d7ed67b6-6d6c-468a-994e-391a4c261d8f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:26.186123 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7ed67b6-6d6c-468a-994e-391a4c261d8f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:26.186572 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7ed67b6-6d6c-468a-994e-391a4c261d8f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:26.187355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7ed67b6-6d6c-468a-994e-391a4c261d8f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:26.187790 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d7ed67b6-6d6c-468a-994e-391a4c261d8f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:26.319634 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d7ed67b6-6d6c-468a-994e-391a4c261d8f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:26.327323 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d7ed67b6-6d6c-468a-994e-391a4c261d8f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1276 microversion: 2.1 time: 0.153351 Jun 15 15:00:26.327891 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 535/1051] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:26 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:27.344390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1cd0d420-0051-42a4-aa81-2602f1d3d408 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:27.345004 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1cd0d420-0051-42a4-aa81-2602f1d3d408 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:27.352233 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1cd0d420-0051-42a4-aa81-2602f1d3d408 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.352692 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1cd0d420-0051-42a4-aa81-2602f1d3d408 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.353461 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1cd0d420-0051-42a4-aa81-2602f1d3d408 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.353900 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1cd0d420-0051-42a4-aa81-2602f1d3d408 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.481364 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1cd0d420-0051-42a4-aa81-2602f1d3d408 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:27.488698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1cd0d420-0051-42a4-aa81-2602f1d3d408 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1276 microversion: 2.1 time: 0.148178 Jun 15 15:00:27.489254 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 517/1052] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:27 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:28.504942 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-9208d303-d51f-4f3a-b09d-187dc8a31ec6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:28.505563 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-9208d303-d51f-4f3a-b09d-187dc8a31ec6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:28.511647 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9208d303-d51f-4f3a-b09d-187dc8a31ec6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.512102 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9208d303-d51f-4f3a-b09d-187dc8a31ec6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.512871 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9208d303-d51f-4f3a-b09d-187dc8a31ec6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.513394 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-9208d303-d51f-4f3a-b09d-187dc8a31ec6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.600337 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bfe8e85-3c58-45bf-9872-c343597263ce"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:28.601645 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:28.608722 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.609255 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.610095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.610602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.650833 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-9208d303-d51f-4f3a-b09d-187dc8a31ec6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:28.658433 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-9208d303-d51f-4f3a-b09d-187dc8a31ec6 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1276 microversion: 2.1 time: 0.157288 Jun 15 15:00:28.659052 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 536/1053] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:28 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:28.692270 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Invalid volume: volume 0bfe8e85-3c58-45bf-9872-c343597263ce is already attached to instances: 4ed6135e-cb3c-4138-9a5d-4125acba45d6 Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: POST /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments HTTP/1.1 Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 74 Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 15:00:28.694095 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {"volumeAttachment": {"volumeId": "0bfe8e85-3c58-45bf-9872-c343597263ce"}} Jun 15 15:00:28.695891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Invalid volume: volume 0bfe8e85-3c58-45bf-9872-c343597263ce is already attached to instances: 4ed6135e-cb3c-4138-9a5d-4125acba45d6 Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'server_id': '4ed6135e-cb3c-4138-9a5d-4125acba45d6', 'body': {'volumeAttachment': {'volumeId': '0bfe8e85-3c58-45bf-9872-c343597263ce'}}} Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0bfe8e85-3c58-45bf-9872-c343597263ce is already attached to instances: 4ed6135e-cb3c-4138-9a5d-4125acba45d6 Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:00:28.699894 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0bfe8e85-3c58-45bf-9872-c343597263ce is already attached to instances: 4ed6135e-cb3c-4138-9a5d-4125acba45d6 Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:28.701208 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:28.702602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:28.702602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:28.702602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:28.702602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0bfe8e85-3c58-45bf-9872-c343597263ce is already attached to instances: 4ed6135e-cb3c-4138-9a5d-4125acba45d6 Jun 15 15:00:28.702602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:00:28.702602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 400 to user: Invalid volume: volume 0bfe8e85-3c58-45bf-9872-c343597263ce is already attached to instances: 4ed6135e-cb3c-4138-9a5d-4125acba45d6 {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:28.702602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4ede5101-3235-49ff-915b-ab79061de95d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100250 Jun 15 15:00:28.702602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 518/1054] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 15:00:28 2022] POST /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 15:00:28.768142 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-709f5dc4-680a-4a79-99db-95be9bd713bb tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:28.768737 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-709f5dc4-680a-4a79-99db-95be9bd713bb tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:28.775275 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-709f5dc4-680a-4a79-99db-95be9bd713bb tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.775733 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-709f5dc4-680a-4a79-99db-95be9bd713bb tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.776499 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-709f5dc4-680a-4a79-99db-95be9bd713bb tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.776940 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-709f5dc4-680a-4a79-99db-95be9bd713bb tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.862124 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-709f5dc4-680a-4a79-99db-95be9bd713bb tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lazy-loading 'services' on Instance uuid 4ed6135e-cb3c-4138-9a5d-4125acba45d6 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:28.933622 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-709f5dc4-680a-4a79-99db-95be9bd713bb tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments/0bfe8e85-3c58-45bf-9872-c343597263ce" status: 202 len: 0 microversion: 2.1 time: 0.169242 Jun 15 15:00:28.934319 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 537/1055] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 15:00:28 2022] DELETE /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments/0bfe8e85-3c58-45bf-9872-c343597263ce => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:28.942383 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-590dbe80-1578-43cb-adf3-c006e399b9fc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:28.943900 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-590dbe80-1578-43cb-adf3-c006e399b9fc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:28.952780 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-590dbe80-1578-43cb-adf3-c006e399b9fc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.953223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-590dbe80-1578-43cb-adf3-c006e399b9fc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.953972 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-590dbe80-1578-43cb-adf3-c006e399b9fc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.954398 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-590dbe80-1578-43cb-adf3-c006e399b9fc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.982628 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-590dbe80-1578-43cb-adf3-c006e399b9fc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044147 Jun 15 15:00:28.983190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 519/1056] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 15:00:28 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:29.676296 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-340ddb7c-8b3b-47c5-8c3b-e8e8109f58b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:29.677598 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-340ddb7c-8b3b-47c5-8c3b-e8e8109f58b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:29.684383 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-340ddb7c-8b3b-47c5-8c3b-e8e8109f58b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:29.684840 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-340ddb7c-8b3b-47c5-8c3b-e8e8109f58b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:29.685606 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-340ddb7c-8b3b-47c5-8c3b-e8e8109f58b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:29.686049 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-340ddb7c-8b3b-47c5-8c3b-e8e8109f58b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:29.818798 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-340ddb7c-8b3b-47c5-8c3b-e8e8109f58b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:29.826316 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-340ddb7c-8b3b-47c5-8c3b-e8e8109f58b8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.154262 Jun 15 15:00:29.826886 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 538/1057] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:29 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:29.995518 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-91779d41-70ad-4814-99a5-29da394de0d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:29.996359 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-91779d41-70ad-4814-99a5-29da394de0d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:30.002964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91779d41-70ad-4814-99a5-29da394de0d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:30.003458 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91779d41-70ad-4814-99a5-29da394de0d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.004262 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91779d41-70ad-4814-99a5-29da394de0d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:30.004704 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91779d41-70ad-4814-99a5-29da394de0d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.035726 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-91779d41-70ad-4814-99a5-29da394de0d3 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Jun 15 15:00:30.036897 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 520/1058] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 15:00:29 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:30.849684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-5e2360e7-21b7-4c1a-9c33-e856feac6acc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:30.850297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-5e2360e7-21b7-4c1a-9c33-e856feac6acc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:30.856805 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5e2360e7-21b7-4c1a-9c33-e856feac6acc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:30.857259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5e2360e7-21b7-4c1a-9c33-e856feac6acc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.858023 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5e2360e7-21b7-4c1a-9c33-e856feac6acc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:30.858461 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-5e2360e7-21b7-4c1a-9c33-e856feac6acc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.986803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-5e2360e7-21b7-4c1a-9c33-e856feac6acc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:30.994752 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-5e2360e7-21b7-4c1a-9c33-e856feac6acc tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.148991 Jun 15 15:00:30.995355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 539/1059] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:30 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:31.047938 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6cf8dc45-a1b6-443d-b213-0fae5ba57862 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:31.048864 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6cf8dc45-a1b6-443d-b213-0fae5ba57862 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:31.055877 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6cf8dc45-a1b6-443d-b213-0fae5ba57862 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.056327 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6cf8dc45-a1b6-443d-b213-0fae5ba57862 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.057088 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6cf8dc45-a1b6-443d-b213-0fae5ba57862 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.057518 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6cf8dc45-a1b6-443d-b213-0fae5ba57862 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.085642 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6cf8dc45-a1b6-443d-b213-0fae5ba57862 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041907 Jun 15 15:00:31.086190 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 521/1060] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 15:00:31 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:00:31.141866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-915b612c-35d1-43cc-adf0-6c1ca09d219b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:31.142445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-915b612c-35d1-43cc-adf0-6c1ca09d219b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:31.148536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-915b612c-35d1-43cc-adf0-6c1ca09d219b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.148993 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-915b612c-35d1-43cc-adf0-6c1ca09d219b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.149758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-915b612c-35d1-43cc-adf0-6c1ca09d219b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.150205 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-915b612c-35d1-43cc-adf0-6c1ca09d219b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.174770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-915b612c-35d1-43cc-adf0-6c1ca09d219b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:00:31.252012 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-915b612c-35d1-43cc-adf0-6c1ca09d219b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 204 len: 0 microversion: 2.1 time: 0.113496 Jun 15 15:00:31.252822 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 540/1061] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:00:31 2022] DELETE /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:00:31.260934 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-be61b106-b9ca-4b2e-a33b-67bcb9a1bb92 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:31.261544 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-be61b106-b9ca-4b2e-a33b-67bcb9a1bb92 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:31.267627 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be61b106-b9ca-4b2e-a33b-67bcb9a1bb92 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.268084 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be61b106-b9ca-4b2e-a33b-67bcb9a1bb92 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.268851 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be61b106-b9ca-4b2e-a33b-67bcb9a1bb92 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.269289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be61b106-b9ca-4b2e-a33b-67bcb9a1bb92 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.397678 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-be61b106-b9ca-4b2e-a33b-67bcb9a1bb92 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:31.405050 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-be61b106-b9ca-4b2e-a33b-67bcb9a1bb92 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1681 microversion: 2.1 time: 0.148023 Jun 15 15:00:31.405607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 522/1062] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:31 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:32.014286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-bdd75db1-db95-4c44-bb89-ff2ec3a65b2e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:32.015129 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bdd75db1-db95-4c44-bb89-ff2ec3a65b2e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:32.017246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:32.018011 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:32.025077 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bdd75db1-db95-4c44-bb89-ff2ec3a65b2e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:32.025528 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bdd75db1-db95-4c44-bb89-ff2ec3a65b2e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:32.026429 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bdd75db1-db95-4c44-bb89-ff2ec3a65b2e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:32.026868 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bdd75db1-db95-4c44-bb89-ff2ec3a65b2e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:32.154503 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-bdd75db1-db95-4c44-bb89-ff2ec3a65b2e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:32.161923 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-bdd75db1-db95-4c44-bb89-ff2ec3a65b2e tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.153779 Jun 15 15:00:32.163048 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 541/1063] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:32 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:32.422224 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-92f234ad-39bb-4526-83db-b4ce529d2878 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:32.422834 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-92f234ad-39bb-4526-83db-b4ce529d2878 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:32.424826 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:32.430690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92f234ad-39bb-4526-83db-b4ce529d2878 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:32.431165 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92f234ad-39bb-4526-83db-b4ce529d2878 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:32.431928 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92f234ad-39bb-4526-83db-b4ce529d2878 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:32.432364 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92f234ad-39bb-4526-83db-b4ce529d2878 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:32.560829 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-92f234ad-39bb-4526-83db-b4ce529d2878 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:32.568182 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-92f234ad-39bb-4526-83db-b4ce529d2878 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1681 microversion: 2.1 time: 0.150045 Jun 15 15:00:32.568734 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 523/1064] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:32 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:33.182030 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f2870290-a27a-4d7d-8bfd-503db4773432 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:33.182896 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f2870290-a27a-4d7d-8bfd-503db4773432 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:33.190228 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2870290-a27a-4d7d-8bfd-503db4773432 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.190676 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2870290-a27a-4d7d-8bfd-503db4773432 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.191490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2870290-a27a-4d7d-8bfd-503db4773432 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.191910 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f2870290-a27a-4d7d-8bfd-503db4773432 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.320932 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f2870290-a27a-4d7d-8bfd-503db4773432 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:33.328381 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f2870290-a27a-4d7d-8bfd-503db4773432 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.152966 Jun 15 15:00:33.328943 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 542/1065] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:33 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:33.585971 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-94e41b32-9b70-4b58-826c-3bf26735f85c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:33.586593 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-94e41b32-9b70-4b58-826c-3bf26735f85c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:33.593183 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94e41b32-9b70-4b58-826c-3bf26735f85c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.593630 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94e41b32-9b70-4b58-826c-3bf26735f85c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.594395 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94e41b32-9b70-4b58-826c-3bf26735f85c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.594833 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94e41b32-9b70-4b58-826c-3bf26735f85c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.741807 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-94e41b32-9b70-4b58-826c-3bf26735f85c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:33.750372 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-94e41b32-9b70-4b58-826c-3bf26735f85c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1681 microversion: 2.1 time: 0.168961 Jun 15 15:00:33.751012 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 524/1066] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:33 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:34.345599 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1e62fd33-4e1f-433d-b03b-b0e12797e2aa tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:34.347268 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1e62fd33-4e1f-433d-b03b-b0e12797e2aa tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:34.354692 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e62fd33-4e1f-433d-b03b-b0e12797e2aa tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.355244 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e62fd33-4e1f-433d-b03b-b0e12797e2aa tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.356029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e62fd33-4e1f-433d-b03b-b0e12797e2aa tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.356498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e62fd33-4e1f-433d-b03b-b0e12797e2aa tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.509662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-1e62fd33-4e1f-433d-b03b-b0e12797e2aa tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:34.517337 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1e62fd33-4e1f-433d-b03b-b0e12797e2aa tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.175625 Jun 15 15:00:34.518547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 543/1067] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:34 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:34.538647 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-e7443a6b-53f7-4716-9d4c-432242b030c3 req-37370c4e-0adb-4970-b807-ad89400dfa4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed6135e-cb3c-4138-9a5d-4125acba45d6", "name": "network-vif-deleted", "tag": "fad1a14a-5696-4c0b-b016-af8964d273d1"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:34.547826 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-e7443a6b-53f7-4716-9d4c-432242b030c3 req-37370c4e-0adb-4970-b807-ad89400dfa4c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.548272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-e7443a6b-53f7-4716-9d4c-432242b030c3 req-37370c4e-0adb-4970-b807-ad89400dfa4c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.565403 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-e7443a6b-53f7-4716-9d4c-432242b030c3 req-37370c4e-0adb-4970-b807-ad89400dfa4c service nova] Creating event network-vif-deleted:fad1a14a-5696-4c0b-b016-af8964d273d1 for instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 on hv-cinder-80382 Jun 15 15:00:34.571376 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-e7443a6b-53f7-4716-9d4c-432242b030c3 req-37370c4e-0adb-4970-b807-ad89400dfa4c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037465 Jun 15 15:00:34.572111 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 525/1068] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:34.767790 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:34.768397 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:34.774808 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.775314 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.776073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.776507 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.806813 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.807312 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.807754 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lazy-loading 'fault' on Instance uuid 4ed6135e-cb3c-4138-9a5d-4125acba45d6 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:34.847662 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:34.855712 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-b992d977-b62a-45fa-bd15-eb6553360bcc tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1331 microversion: 2.1 time: 0.091818 Jun 15 15:00:34.856267 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 544/1069] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:34 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:35.536263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9246c7ed-831b-41d4-95b0-e6d5edeebd16 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:35.536963 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9246c7ed-831b-41d4-95b0-e6d5edeebd16 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:35.543261 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9246c7ed-831b-41d4-95b0-e6d5edeebd16 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.543966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9246c7ed-831b-41d4-95b0-e6d5edeebd16 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.544723 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9246c7ed-831b-41d4-95b0-e6d5edeebd16 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.545163 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9246c7ed-831b-41d4-95b0-e6d5edeebd16 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.680682 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9246c7ed-831b-41d4-95b0-e6d5edeebd16 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:35.688140 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9246c7ed-831b-41d4-95b0-e6d5edeebd16 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.156618 Jun 15 15:00:35.688697 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 526/1070] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:35 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:35.872877 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:35.873542 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:35.880012 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.880461 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.881219 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.881658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.911759 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.912849 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.913301 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lazy-loading 'fault' on Instance uuid 4ed6135e-cb3c-4138-9a5d-4125acba45d6 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:35.953999 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:35.961366 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-f391018e-8fa3-427e-908e-542bf80972b1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 200 len: 1331 microversion: 2.1 time: 0.092418 Jun 15 15:00:35.961929 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 545/1071] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:35 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:36.704853 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ee306311-1bc9-4cf6-bbe2-9338b07d8dd1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:36.705493 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ee306311-1bc9-4cf6-bbe2-9338b07d8dd1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:36.712621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee306311-1bc9-4cf6-bbe2-9338b07d8dd1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:36.713061 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee306311-1bc9-4cf6-bbe2-9338b07d8dd1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:36.713814 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee306311-1bc9-4cf6-bbe2-9338b07d8dd1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:36.714245 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee306311-1bc9-4cf6-bbe2-9338b07d8dd1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:36.842910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ee306311-1bc9-4cf6-bbe2-9338b07d8dd1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:36.850354 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ee306311-1bc9-4cf6-bbe2-9338b07d8dd1 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.149418 Jun 15 15:00:36.850908 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 527/1072] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:36 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:36.978433 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:36.979013 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:36.985457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:36.985907 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:36.986768 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:36.987245 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.000884 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 HTTP/1.1 Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 15:00:37.002495 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:00:37.004114 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '4ed6135e-cb3c-4138-9a5d-4125acba45d6'} Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:37.005063 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:00:37.007241 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:00:37.008753 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:37.008753 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-832a160d-5686-4222-83c5-265332066a6c tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 404 len: 111 microversion: 2.1 time: 0.029584 Jun 15 15:00:37.008753 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 546/1073] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:36 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:37.013270 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-da20725d-5600-4c65-aefc-b09f1dd81242 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '.version_select at 0x7f05bc03d9d0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:37.030233 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-da20725d-5600-4c65-aefc-b09f1dd81242 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882282095" status: 202 len: 0 microversion: 2.1 time: 0.020734 Jun 15 15:00:37.030784 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 528/1074] 10.222.0.45 () {58 vars in 1220 bytes} [Wed Jun 15 15:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882282095 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:37.669970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ca0766b9-7140-4a9c-8a57-81369b41fda1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: .version_select at 0x7f05bc0a4af0>, body: {"keypair": {"name": "tempest-keypair-1668174609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxk/zdMmCGTJSyNmtjIyFdKvdRHLoDviK8sGd3s4qiuDJyoUhI3X4RR1vQKYi+OpGrIWO8/wkIP7Vv3sewgvE7GZto44ZijnPOfqHnmNpGB4aIHl+3aFF3ymxMadOstZg=="}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:37.685299 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-ca0766b9-7140-4a9c-8a57-81369b41fda1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:00:37.689513 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-ca0766b9-7140-4a9c-8a57-81369b41fda1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for user 1f95ff4743414cbc8cc9a213e508113b and project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'key_pairs'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:00:37.716144 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ca0766b9-7140-4a9c-8a57-81369b41fda1 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050624 Jun 15 15:00:37.716819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 547/1075] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 15:00:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:37.873899 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f800d7cc-9a27-46cf-b488-4921b0174acd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:37.875291 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f800d7cc-9a27-46cf-b488-4921b0174acd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:37.884806 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f800d7cc-9a27-46cf-b488-4921b0174acd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.885547 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f800d7cc-9a27-46cf-b488-4921b0174acd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.886529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f800d7cc-9a27-46cf-b488-4921b0174acd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.887168 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f800d7cc-9a27-46cf-b488-4921b0174acd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.088263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f800d7cc-9a27-46cf-b488-4921b0174acd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:38.097803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f800d7cc-9a27-46cf-b488-4921b0174acd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.227415 Jun 15 15:00:38.097803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 529/1076] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:37 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:39.115005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-06ce7402-3ba7-4be3-a8fc-0f46231e0596 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:39.115631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-06ce7402-3ba7-4be3-a8fc-0f46231e0596 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:39.122453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-06ce7402-3ba7-4be3-a8fc-0f46231e0596 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:39.123025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-06ce7402-3ba7-4be3-a8fc-0f46231e0596 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.123992 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-06ce7402-3ba7-4be3-a8fc-0f46231e0596 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:39.124428 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-06ce7402-3ba7-4be3-a8fc-0f46231e0596 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.143758 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:39.352467 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-a1a179de-22d9-4d27-ae35-f7aff40b7dd3 req-ef9ffaff-2fcd-4bf2-adda-1e6d1d5802d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a517126-ffcc-4783-a8fa-933ac859bddc", "name": "network-vif-plugged", "status": "completed", "tag": "1bb24e2b-aca5-4f2e-b4c4-df1294f1257a"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:39.359254 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-06ce7402-3ba7-4be3-a8fc-0f46231e0596 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:39.363036 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-a1a179de-22d9-4d27-ae35-f7aff40b7dd3 req-ef9ffaff-2fcd-4bf2-adda-1e6d1d5802d2 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:39.363477 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-a1a179de-22d9-4d27-ae35-f7aff40b7dd3 req-ef9ffaff-2fcd-4bf2-adda-1e6d1d5802d2 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.367706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:39.367934 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-06ce7402-3ba7-4be3-a8fc-0f46231e0596 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.258096 Jun 15 15:00:39.369045 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 548/1077] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:39 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:39.378275 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-a1a179de-22d9-4d27-ae35-f7aff40b7dd3 req-ef9ffaff-2fcd-4bf2-adda-1e6d1d5802d2 service nova] Creating event network-vif-plugged:1bb24e2b-aca5-4f2e-b4c4-df1294f1257a for instance 9a517126-ffcc-4783-a8fa-933ac859bddc on hv-cinder-80382 Jun 15 15:00:39.379670 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-478202750", "imageRef": "fc67f41b-667e-4d89-ade4-bdc48dcf1f96", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3fe8514-b139-4a79-925c-aad99761c6b3"}], "security_groups": [{"name": "tempest-securitygroup--1731753834"}], "key_name": "tempest-keypair-1668174609", "user_data": "}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:39.384567 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-a1a179de-22d9-4d27-ae35-f7aff40b7dd3 req-ef9ffaff-2fcd-4bf2-adda-1e6d1d5802d2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117509 Jun 15 15:00:39.385160 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 530/1078] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:39.484594 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] validate_networks() for [('f3fe8514-b139-4a79-925c-aad99761c6b3', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:00:39.844573 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:00:39.845006 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:00:39.845519 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:00:39.845935 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:00:39.846352 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:00:39.855262 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:39.855713 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.856518 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:39.856955 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.873728 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:00:39.877705 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Getting quotas for user 1f95ff4743414cbc8cc9a213e508113b and project 9ad78ee5bf484207a38d465c3499b5d4. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:00:39.889277 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:00:39.891536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc67f41b-667e-4d89-ade4-bdc48dcf1f96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:00:39.936770 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fdf68f31-e7ac-48a5-a643-8c7fa9685f16 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.561493 Jun 15 15:00:39.937411 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 549/1079] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 15:00:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:00:39.949019 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-166a5d2c-ae53-43b8-9d31-e671af6c3242 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:39.949752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-166a5d2c-ae53-43b8-9d31-e671af6c3242 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:40.003417 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-166a5d2c-ae53-43b8-9d31-e671af6c3242 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:40.010710 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-166a5d2c-ae53-43b8-9d31-e671af6c3242 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1241 microversion: 2.1 time: 0.066309 Jun 15 15:00:40.011418 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 531/1080] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:39 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:40.384899 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-70c59b10-af7a-41d0-97a3-aea0fb907169 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:40.385547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-70c59b10-af7a-41d0-97a3-aea0fb907169 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:40.392403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70c59b10-af7a-41d0-97a3-aea0fb907169 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:40.392802 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70c59b10-af7a-41d0-97a3-aea0fb907169 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:40.393568 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70c59b10-af7a-41d0-97a3-aea0fb907169 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:40.394042 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70c59b10-af7a-41d0-97a3-aea0fb907169 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:40.522297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-70c59b10-af7a-41d0-97a3-aea0fb907169 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:40.530015 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-70c59b10-af7a-41d0-97a3-aea0fb907169 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1264 microversion: 2.1 time: 0.149539 Jun 15 15:00:40.530586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 550/1081] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:40 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:41.028428 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eb96bfbf-46bf-4232-8338-fd99a8589020 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:41.028966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-eb96bfbf-46bf-4232-8338-fd99a8589020 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:41.035697 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb96bfbf-46bf-4232-8338-fd99a8589020 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.036153 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb96bfbf-46bf-4232-8338-fd99a8589020 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.036925 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb96bfbf-46bf-4232-8338-fd99a8589020 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.037374 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eb96bfbf-46bf-4232-8338-fd99a8589020 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.101162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-eb96bfbf-46bf-4232-8338-fd99a8589020 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:41.108536 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-eb96bfbf-46bf-4232-8338-fd99a8589020 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1293 microversion: 2.1 time: 0.084080 Jun 15 15:00:41.109102 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 532/1082] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:41 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:41.547643 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-92a9be91-df74-4388-82ca-ba24e5fd8c97 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:41.548288 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-92a9be91-df74-4388-82ca-ba24e5fd8c97 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:41.555523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-92a9be91-df74-4388-82ca-ba24e5fd8c97 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.555976 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-92a9be91-df74-4388-82ca-ba24e5fd8c97 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.556739 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-92a9be91-df74-4388-82ca-ba24e5fd8c97 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.557174 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-92a9be91-df74-4388-82ca-ba24e5fd8c97 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.691313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-92a9be91-df74-4388-82ca-ba24e5fd8c97 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:41.699711 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-92a9be91-df74-4388-82ca-ba24e5fd8c97 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1450 microversion: 2.1 time: 0.156152 Jun 15 15:00:41.700287 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 551/1083] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:41 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:41.716935 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-81fe12bf-4cde-488d-ab2d-48ffc46348a2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:41.717479 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-81fe12bf-4cde-488d-ab2d-48ffc46348a2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:41.723804 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81fe12bf-4cde-488d-ab2d-48ffc46348a2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.724249 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81fe12bf-4cde-488d-ab2d-48ffc46348a2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.725047 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81fe12bf-4cde-488d-ab2d-48ffc46348a2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.725479 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81fe12bf-4cde-488d-ab2d-48ffc46348a2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.870752 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-81fe12bf-4cde-488d-ab2d-48ffc46348a2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:41.883741 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-81fe12bf-4cde-488d-ab2d-48ffc46348a2 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1450 microversion: 2.1 time: 0.170748 Jun 15 15:00:41.884679 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 533/1084] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:41 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:42.124971 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-41511329-e785-49f1-a703-8f04a0f24344 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:42.125589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-41511329-e785-49f1-a703-8f04a0f24344 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:42.132164 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-41511329-e785-49f1-a703-8f04a0f24344 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:42.132616 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-41511329-e785-49f1-a703-8f04a0f24344 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:42.133384 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-41511329-e785-49f1-a703-8f04a0f24344 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:42.133817 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-41511329-e785-49f1-a703-8f04a0f24344 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:42.206837 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-41511329-e785-49f1-a703-8f04a0f24344 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:42.216279 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-41511329-e785-49f1-a703-8f04a0f24344 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1299 microversion: 2.1 time: 0.094857 Jun 15 15:00:42.217105 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 552/1085] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:42 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:43.236248 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-174c8501-6569-489e-a20a-fac5055814f5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:43.236871 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-174c8501-6569-489e-a20a-fac5055814f5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:43.244294 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-174c8501-6569-489e-a20a-fac5055814f5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:43.245085 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-174c8501-6569-489e-a20a-fac5055814f5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:43.245875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-174c8501-6569-489e-a20a-fac5055814f5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:43.246309 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-174c8501-6569-489e-a20a-fac5055814f5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:43.382808 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-174c8501-6569-489e-a20a-fac5055814f5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:43.390344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-174c8501-6569-489e-a20a-fac5055814f5 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1367 microversion: 2.1 time: 0.159683 Jun 15 15:00:43.390920 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 534/1086] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:43 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:44.407062 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-4a30493c-db6f-436c-8ce7-389a92b423c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:44.407628 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-4a30493c-db6f-436c-8ce7-389a92b423c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:44.414756 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4a30493c-db6f-436c-8ce7-389a92b423c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:44.415355 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4a30493c-db6f-436c-8ce7-389a92b423c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:44.416088 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4a30493c-db6f-436c-8ce7-389a92b423c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:44.416505 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-4a30493c-db6f-436c-8ce7-389a92b423c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:44.559724 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-4a30493c-db6f-436c-8ce7-389a92b423c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:44.567453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-4a30493c-db6f-436c-8ce7-389a92b423c8 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1367 microversion: 2.1 time: 0.164352 Jun 15 15:00:44.567998 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 553/1087] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:44 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:44.656859 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-7e6e733e-2e02-451a-8bc9-548f565135a0 req-1e317e72-7424-456c-979e-3b7c091059b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65cc5aa2-9d97-470c-bb9e-a32119766e03", "tag": "1aa4f501-6447-4ae9-9aa9-6cd9aca955fa"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:44.690168 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7e6e733e-2e02-451a-8bc9-548f565135a0 req-1e317e72-7424-456c-979e-3b7c091059b2 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:44.691584 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7e6e733e-2e02-451a-8bc9-548f565135a0 req-1e317e72-7424-456c-979e-3b7c091059b2 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:44.714457 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-7e6e733e-2e02-451a-8bc9-548f565135a0 req-1e317e72-7424-456c-979e-3b7c091059b2 service nova] Creating event network-changed:1aa4f501-6447-4ae9-9aa9-6cd9aca955fa for instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 on hv-cinder-80382 Jun 15 15:00:44.727642 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-7e6e733e-2e02-451a-8bc9-548f565135a0 req-1e317e72-7424-456c-979e-3b7c091059b2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072367 Jun 15 15:00:44.728321 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 535/1088] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:45.589367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8654df5b-8298-45c5-bdd4-f6be3b0ca863 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:45.590113 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8654df5b-8298-45c5-bdd4-f6be3b0ca863 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:45.597674 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8654df5b-8298-45c5-bdd4-f6be3b0ca863 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:45.598124 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8654df5b-8298-45c5-bdd4-f6be3b0ca863 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:45.598930 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8654df5b-8298-45c5-bdd4-f6be3b0ca863 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:45.599437 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8654df5b-8298-45c5-bdd4-f6be3b0ca863 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:45.754059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8654df5b-8298-45c5-bdd4-f6be3b0ca863 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:45.764000 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8654df5b-8298-45c5-bdd4-f6be3b0ca863 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1367 microversion: 2.1 time: 0.178148 Jun 15 15:00:45.765042 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 554/1089] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:45 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:46.758258 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-5ee4edf7-5eb5-47ed-8597-233a2586b1df req-1c1b4f5e-1b06-460b-a380-81187f6d951e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a517126-ffcc-4783-a8fa-933ac859bddc", "tag": "1bb24e2b-aca5-4f2e-b4c4-df1294f1257a"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:46.762188 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:46.768144 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5ee4edf7-5eb5-47ed-8597-233a2586b1df req-1c1b4f5e-1b06-460b-a380-81187f6d951e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:46.768590 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5ee4edf7-5eb5-47ed-8597-233a2586b1df req-1c1b4f5e-1b06-460b-a380-81187f6d951e service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:46.780747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-5ee4edf7-5eb5-47ed-8597-233a2586b1df req-1c1b4f5e-1b06-460b-a380-81187f6d951e service nova] Creating event network-changed:1bb24e2b-aca5-4f2e-b4c4-df1294f1257a for instance 9a517126-ffcc-4783-a8fa-933ac859bddc on hv-cinder-80382 Jun 15 15:00:46.781827 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fa9c1590-075b-4857-b8f1-bb18666053c6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:46.782440 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fa9c1590-075b-4857-b8f1-bb18666053c6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:46.785707 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-5ee4edf7-5eb5-47ed-8597-233a2586b1df req-1c1b4f5e-1b06-460b-a380-81187f6d951e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031565 Jun 15 15:00:46.785884 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:46.786497 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 536/1090] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:46.790736 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fa9c1590-075b-4857-b8f1-bb18666053c6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:46.791234 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fa9c1590-075b-4857-b8f1-bb18666053c6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:46.792005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fa9c1590-075b-4857-b8f1-bb18666053c6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:46.792439 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fa9c1590-075b-4857-b8f1-bb18666053c6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:46.938240 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fa9c1590-075b-4857-b8f1-bb18666053c6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:46.945792 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fa9c1590-075b-4857-b8f1-bb18666053c6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1367 microversion: 2.1 time: 0.167849 Jun 15 15:00:46.946367 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 555/1091] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:46 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:47.962721 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-528f2ec6-4d1c-4da1-82df-7eef18735bba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:47.963444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-528f2ec6-4d1c-4da1-82df-7eef18735bba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:47.970207 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-528f2ec6-4d1c-4da1-82df-7eef18735bba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:47.970657 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-528f2ec6-4d1c-4da1-82df-7eef18735bba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:47.971449 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-528f2ec6-4d1c-4da1-82df-7eef18735bba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:47.971879 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-528f2ec6-4d1c-4da1-82df-7eef18735bba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.216900 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-528f2ec6-4d1c-4da1-82df-7eef18735bba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:48.226229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-528f2ec6-4d1c-4da1-82df-7eef18735bba tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1367 microversion: 2.1 time: 0.268145 Jun 15 15:00:48.227080 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 537/1092] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:47 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:49.244030 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-989a7e2a-54c6-42b3-8056-d1166a513b9a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:49.244644 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-989a7e2a-54c6-42b3-8056-d1166a513b9a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:49.251529 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-989a7e2a-54c6-42b3-8056-d1166a513b9a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:49.251984 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-989a7e2a-54c6-42b3-8056-d1166a513b9a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:49.252748 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-989a7e2a-54c6-42b3-8056-d1166a513b9a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:49.253196 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-989a7e2a-54c6-42b3-8056-d1166a513b9a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:49.403655 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-989a7e2a-54c6-42b3-8056-d1166a513b9a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:49.411112 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-989a7e2a-54c6-42b3-8056-d1166a513b9a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1367 microversion: 2.1 time: 0.171615 Jun 15 15:00:49.412714 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 556/1093] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:49 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:49.504953 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-c8c14326-461e-45c6-8d69-1832c020402d req-0aa96060-5d6a-4257-8137-1d99294ecd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65cc5aa2-9d97-470c-bb9e-a32119766e03", "name": "network-vif-plugged", "status": "completed", "tag": "1aa4f501-6447-4ae9-9aa9-6cd9aca955fa"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:49.516846 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-c8c14326-461e-45c6-8d69-1832c020402d req-0aa96060-5d6a-4257-8137-1d99294ecd13 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:49.517288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-c8c14326-461e-45c6-8d69-1832c020402d req-0aa96060-5d6a-4257-8137-1d99294ecd13 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:49.529161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-c8c14326-461e-45c6-8d69-1832c020402d req-0aa96060-5d6a-4257-8137-1d99294ecd13 service nova] Creating event network-vif-plugged:1aa4f501-6447-4ae9-9aa9-6cd9aca955fa for instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 on hv-cinder-80382 Jun 15 15:00:49.533886 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-c8c14326-461e-45c6-8d69-1832c020402d req-0aa96060-5d6a-4257-8137-1d99294ecd13 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Jun 15 15:00:49.534473 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 538/1094] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:50.433306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-960c2c47-7152-4e57-b82a-80daabbf9897 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:50.433958 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-960c2c47-7152-4e57-b82a-80daabbf9897 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:50.436254 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:50.436942 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=10 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:50.445280 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-960c2c47-7152-4e57-b82a-80daabbf9897 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:50.445922 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-960c2c47-7152-4e57-b82a-80daabbf9897 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:50.446983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-960c2c47-7152-4e57-b82a-80daabbf9897 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:50.447607 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-960c2c47-7152-4e57-b82a-80daabbf9897 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:50.585420 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-960c2c47-7152-4e57-b82a-80daabbf9897 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:50.592891 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-960c2c47-7152-4e57-b82a-80daabbf9897 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1367 microversion: 2.1 time: 0.165025 Jun 15 15:00:50.593458 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 557/1095] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:50 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:51.606845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:51.611646 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-74e2bbeb-7b0f-4f79-9882-a542d07f157f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:51.612344 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-74e2bbeb-7b0f-4f79-9882-a542d07f157f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:51.619423 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74e2bbeb-7b0f-4f79-9882-a542d07f157f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.619875 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74e2bbeb-7b0f-4f79-9882-a542d07f157f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.620641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74e2bbeb-7b0f-4f79-9882-a542d07f157f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.621077 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74e2bbeb-7b0f-4f79-9882-a542d07f157f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.750576 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-74e2bbeb-7b0f-4f79-9882-a542d07f157f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:51.757988 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-74e2bbeb-7b0f-4f79-9882-a542d07f157f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1367 microversion: 2.1 time: 0.152073 Jun 15 15:00:51.758550 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 539/1096] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:51 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:52.775339 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-3a4bff2a-7a16-4186-968a-e5af8c4b010f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:52.775951 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-3a4bff2a-7a16-4186-968a-e5af8c4b010f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:52.782390 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3a4bff2a-7a16-4186-968a-e5af8c4b010f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.782835 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3a4bff2a-7a16-4186-968a-e5af8c4b010f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.783750 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3a4bff2a-7a16-4186-968a-e5af8c4b010f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.784177 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-3a4bff2a-7a16-4186-968a-e5af8c4b010f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.920011 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-3a4bff2a-7a16-4186-968a-e5af8c4b010f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:52.927441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-3a4bff2a-7a16-4186-968a-e5af8c4b010f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1556 microversion: 2.1 time: 0.156654 Jun 15 15:00:52.928587 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 558/1097] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:52 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:52.944964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7a981e80-a968-4822-8f9b-87416cd91082 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:52.944964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7a981e80-a968-4822-8f9b-87416cd91082 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:52.950982 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7a981e80-a968-4822-8f9b-87416cd91082 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.951470 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7a981e80-a968-4822-8f9b-87416cd91082 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.952238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7a981e80-a968-4822-8f9b-87416cd91082 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.952680 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7a981e80-a968-4822-8f9b-87416cd91082 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:53.028437 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7a981e80-a968-4822-8f9b-87416cd91082 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088185 Jun 15 15:00:53.029031 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 540/1098] 10.222.0.45 () {58 vars in 1274 bytes} [Wed Jun 15 15:00:52 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:54.034703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-bb93fed7-4eec-4771-aac0-88a96cc4f7a0 req-042ce5c3-0f1b-42f3-8b7a-3b83a1fea3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65cc5aa2-9d97-470c-bb9e-a32119766e03", "tag": "1aa4f501-6447-4ae9-9aa9-6cd9aca955fa"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:54.043032 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-bb93fed7-4eec-4771-aac0-88a96cc4f7a0 req-042ce5c3-0f1b-42f3-8b7a-3b83a1fea3c6 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:54.043552 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-bb93fed7-4eec-4771-aac0-88a96cc4f7a0 req-042ce5c3-0f1b-42f3-8b7a-3b83a1fea3c6 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:54.055456 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-bb93fed7-4eec-4771-aac0-88a96cc4f7a0 req-042ce5c3-0f1b-42f3-8b7a-3b83a1fea3c6 service nova] Creating event network-changed:1aa4f501-6447-4ae9-9aa9-6cd9aca955fa for instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 on hv-cinder-80382 Jun 15 15:00:54.060536 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-bb93fed7-4eec-4771-aac0-88a96cc4f7a0 req-042ce5c3-0f1b-42f3-8b7a-3b83a1fea3c6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090744 Jun 15 15:00:54.061060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 559/1099] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:10.353117 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:01:10.353706 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 15:01:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:02:23.609420 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=9 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:23.610161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=40 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:23.614518 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9fdfbb5f-eb3d-40b2-8257-0ae892d78ff6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:23.615063 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9fdfbb5f-eb3d-40b2-8257-0ae892d78ff6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:23.621790 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9fdfbb5f-eb3d-40b2-8257-0ae892d78ff6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:23.622241 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9fdfbb5f-eb3d-40b2-8257-0ae892d78ff6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:23.623024 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9fdfbb5f-eb3d-40b2-8257-0ae892d78ff6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:23.623460 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9fdfbb5f-eb3d-40b2-8257-0ae892d78ff6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:23.646181 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9fdfbb5f-eb3d-40b2-8257-0ae892d78ff6 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/ips" status: 200 len: 148 microversion: 2.1 time: 0.038669 Jun 15 15:02:23.646729 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 541/1100] 10.222.0.45 () {58 vars in 1247 bytes} [Wed Jun 15 15:02:23 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:24.950857 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=8 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:24.951682 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=60 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:24.956238 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-065087a2-fa83-44c3-a8c3-b2d3bfe20109 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4716ded6-c67e-4967-8a11-2832b2780ed8"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:24.957403 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-065087a2-fa83-44c3-a8c3-b2d3bfe20109 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:24.964294 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-065087a2-fa83-44c3-a8c3-b2d3bfe20109 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:24.964749 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-065087a2-fa83-44c3-a8c3-b2d3bfe20109 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:24.965512 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-065087a2-fa83-44c3-a8c3-b2d3bfe20109 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:24.965953 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-065087a2-fa83-44c3-a8c3-b2d3bfe20109 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:25.224438 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-065087a2-fa83-44c3-a8c3-b2d3bfe20109 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "POST /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276217 Jun 15 15:02:25.225059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 560/1101] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 15:02:24 2022] POST /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:32.805892 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3975d689-6920-42da-bc92-9a69d91ae91f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:32.806386 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3975d689-6920-42da-bc92-9a69d91ae91f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:32.812758 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3975d689-6920-42da-bc92-9a69d91ae91f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:32.813206 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3975d689-6920-42da-bc92-9a69d91ae91f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:32.813962 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3975d689-6920-42da-bc92-9a69d91ae91f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:32.814397 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3975d689-6920-42da-bc92-9a69d91ae91f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:32.892191 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-3975d689-6920-42da-bc92-9a69d91ae91f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lazy-loading 'services' on Instance uuid 65cc5aa2-9d97-470c-bb9e-a32119766e03 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:02:32.964510 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3975d689-6920-42da-bc92-9a69d91ae91f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-volume_attachments/4716ded6-c67e-4967-8a11-2832b2780ed8" status: 202 len: 0 microversion: 2.1 time: 0.162354 Jun 15 15:02:32.965117 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 542/1102] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 15:02:32 2022] DELETE /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-volume_attachments/4716ded6-c67e-4967-8a11-2832b2780ed8 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:02:32.974458 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-15f1b669-03df-493f-972a-567e1726375b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:32.975508 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-15f1b669-03df-493f-972a-567e1726375b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:32.981889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-15f1b669-03df-493f-972a-567e1726375b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:32.982349 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-15f1b669-03df-493f-972a-567e1726375b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:32.983259 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-15f1b669-03df-493f-972a-567e1726375b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:32.983680 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-15f1b669-03df-493f-972a-567e1726375b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:33.013633 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-15f1b669-03df-493f-972a-567e1726375b tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Jun 15 15:02:33.014185 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 561/1103] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 15:02:32 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:34.027146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2bdc5198-d6b7-481b-8a95-ff896755ac2f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:34.028849 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2bdc5198-d6b7-481b-8a95-ff896755ac2f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:34.035048 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bdc5198-d6b7-481b-8a95-ff896755ac2f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.035502 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bdc5198-d6b7-481b-8a95-ff896755ac2f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.036268 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bdc5198-d6b7-481b-8a95-ff896755ac2f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.036704 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bdc5198-d6b7-481b-8a95-ff896755ac2f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.064754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2bdc5198-d6b7-481b-8a95-ff896755ac2f tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042707 Jun 15 15:02:34.065324 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 543/1104] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 15:02:34 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:02:34.120560 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a58f2fd4-2be1-437c-8123-c630c1f6aa9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:34.121037 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a58f2fd4-2be1-437c-8123-c630c1f6aa9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:34.127433 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a58f2fd4-2be1-437c-8123-c630c1f6aa9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.127882 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a58f2fd4-2be1-437c-8123-c630c1f6aa9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.128637 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a58f2fd4-2be1-437c-8123-c630c1f6aa9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.129072 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a58f2fd4-2be1-437c-8123-c630c1f6aa9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.154473 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a58f2fd4-2be1-437c-8123-c630c1f6aa9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:02:34.229578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a58f2fd4-2be1-437c-8123-c630c1f6aa9d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 204 len: 0 microversion: 2.1 time: 0.112503 Jun 15 15:02:34.230290 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 562/1105] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:02:34 2022] DELETE /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:02:34.238785 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f9c5c9be-7712-4053-8345-53a243ebb5b2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:34.239425 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f9c5c9be-7712-4053-8345-53a243ebb5b2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:34.245353 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9c5c9be-7712-4053-8345-53a243ebb5b2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.245801 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9c5c9be-7712-4053-8345-53a243ebb5b2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.246711 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9c5c9be-7712-4053-8345-53a243ebb5b2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.247173 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9c5c9be-7712-4053-8345-53a243ebb5b2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.376285 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f9c5c9be-7712-4053-8345-53a243ebb5b2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:34.383750 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f9c5c9be-7712-4053-8345-53a243ebb5b2 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1680 microversion: 2.1 time: 0.148870 Jun 15 15:02:34.384305 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 544/1106] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:34 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:35.401024 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-130ff7d1-eed5-4f21-b162-75a4fa3b3d37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:35.401725 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-130ff7d1-eed5-4f21-b162-75a4fa3b3d37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:35.408776 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-130ff7d1-eed5-4f21-b162-75a4fa3b3d37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:35.409230 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-130ff7d1-eed5-4f21-b162-75a4fa3b3d37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:35.409993 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-130ff7d1-eed5-4f21-b162-75a4fa3b3d37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:35.410428 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-130ff7d1-eed5-4f21-b162-75a4fa3b3d37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:35.546624 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-130ff7d1-eed5-4f21-b162-75a4fa3b3d37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:35.554025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-130ff7d1-eed5-4f21-b162-75a4fa3b3d37 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1680 microversion: 2.1 time: 0.157271 Jun 15 15:02:35.554581 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 563/1107] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:35 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:36.570805 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c02a2b4b-8a20-4fc2-97a4-1ecc896ab15d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:36.571438 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c02a2b4b-8a20-4fc2-97a4-1ecc896ab15d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:36.578331 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c02a2b4b-8a20-4fc2-97a4-1ecc896ab15d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:36.578774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c02a2b4b-8a20-4fc2-97a4-1ecc896ab15d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:36.579571 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c02a2b4b-8a20-4fc2-97a4-1ecc896ab15d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:36.580004 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c02a2b4b-8a20-4fc2-97a4-1ecc896ab15d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:37.048726 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c02a2b4b-8a20-4fc2-97a4-1ecc896ab15d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:37.056168 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c02a2b4b-8a20-4fc2-97a4-1ecc896ab15d tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1680 microversion: 2.1 time: 0.489187 Jun 15 15:02:37.056757 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 545/1108] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:36 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1680 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:37.574779 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-acb9fff7-21f0-4d38-8e3b-2cc6bede7efe req-defed02e-0d01-4596-8aa3-f87f0a267886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65cc5aa2-9d97-470c-bb9e-a32119766e03", "name": "network-vif-deleted", "tag": "1aa4f501-6447-4ae9-9aa9-6cd9aca955fa"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:37.584627 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-acb9fff7-21f0-4d38-8e3b-2cc6bede7efe req-defed02e-0d01-4596-8aa3-f87f0a267886 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:37.585371 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-acb9fff7-21f0-4d38-8e3b-2cc6bede7efe req-defed02e-0d01-4596-8aa3-f87f0a267886 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:37.598093 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-acb9fff7-21f0-4d38-8e3b-2cc6bede7efe req-defed02e-0d01-4596-8aa3-f87f0a267886 service nova] Creating event network-vif-deleted:1aa4f501-6447-4ae9-9aa9-6cd9aca955fa for instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 on hv-cinder-80382 Jun 15 15:02:37.603362 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-acb9fff7-21f0-4d38-8e3b-2cc6bede7efe req-defed02e-0d01-4596-8aa3-f87f0a267886 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032378 Jun 15 15:02:37.604173 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 564/1109] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:38.073503 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:38.074642 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:38.081408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:38.081870 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:38.082644 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:38.083107 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:38.114773 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:38.115305 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:38.115765 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lazy-loading 'fault' on Instance uuid 65cc5aa2-9d97-470c-bb9e-a32119766e03 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:02:38.160851 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95ff4743414cbc8cc9a213e508113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad78ee5bf484207a38d465c3499b5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:38.169381 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-80ff0f3b-4c20-41e0-8130-5d09c864609e tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 200 len: 1331 microversion: 2.1 time: 0.099606 Jun 15 15:02:38.169958 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 546/1110] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:38 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:39.188459 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:39.189424 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:39.195699 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:39.196150 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:39.196911 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:39.197346 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:39.211264 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 HTTP/1.1 Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 15:02:39.212866 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:39.214520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '65cc5aa2-9d97-470c-bb9e-a32119766e03'} Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:39.215702 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:39.217297 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:39.218942 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:39.218942 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6d0cc202-8b40-4076-9200-7e204fc9eb23 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 404 len: 111 microversion: 2.1 time: 0.031017 Jun 15 15:02:39.218942 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 565/1111] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:39 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:39.225632 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c40f35cd-7edf-45be-8a51-f4898338a945 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '.version_select at 0x7f05bc09a1f0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:39.242528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c40f35cd-7edf-45be-8a51-f4898338a945 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668174609" status: 202 len: 0 microversion: 2.1 time: 0.022864 Jun 15 15:02:39.243115 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 547/1112] 10.222.0.45 () {58 vars in 1220 bytes} [Wed Jun 15 15:02:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668174609 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:02:40.963958 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:40.964452 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:40.970797 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:40.971285 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:40.972073 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:40.972511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:40.988313 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: DELETE /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 HTTP/1.1 Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 15:02:40.989763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:40.991453 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '65cc5aa2-9d97-470c-bb9e-a32119766e03'} Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:40.992546 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:40.994028 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:40.995829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:40.995829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-e78e69a5-27c5-4a59-bea5-6bea779316b0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 404 len: 111 microversion: 2.1 time: 0.030969 Jun 15 15:02:40.995829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 566/1113] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:02:40 2022] DELETE /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:41.000587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:41.001196 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 65cc5aa2-9d97-470c-bb9e-a32119766e03] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:41.007777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:41.008229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:41.008986 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:41.009420 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:41.022435 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 HTTP/1.1 Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 15:02:41.024146 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:41.025751 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '65cc5aa2-9d97-470c-bb9e-a32119766e03'} Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:41.026738 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. Jun 15 15:02:41.028010 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:41.029215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance 65cc5aa2-9d97-470c-bb9e-a32119766e03 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:41.029215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4d13d860-c59d-49aa-b804-0b9ee8fbe2c0 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03" status: 404 len: 111 microversion: 2.1 time: 0.029990 Jun 15 15:02:41.029215 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 548/1114] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:40 2022] GET /compute/v2.1/servers/65cc5aa2-9d97-470c-bb9e-a32119766e03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:42.157183 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:42.157668 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:42.164135 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.164583 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.165349 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.165782 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.179362 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: DELETE /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 HTTP/1.1 Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 15:02:42.180961 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.182374 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '4ed6135e-cb3c-4138-9a5d-4125acba45d6'} Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:42.183246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.185064 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.186645 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:42.186645 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-aecf99e4-38e3-40c5-9e48-0892244e53f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 404 len: 111 microversion: 2.1 time: 0.029018 Jun 15 15:02:42.186645 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 567/1115] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:02:42 2022] DELETE /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:42.192966 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:42.193585 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 4ed6135e-cb3c-4138-9a5d-4125acba45d6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:42.200777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.201229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.201997 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.202432 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.215560 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 HTTP/1.1 Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 15:02:42.217079 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.218691 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '4ed6135e-cb3c-4138-9a5d-4125acba45d6'} Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:42.219777 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. Jun 15 15:02:42.221204 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.222619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance 4ed6135e-cb3c-4138-9a5d-4125acba45d6 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:42.222619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-371ae057-5d2d-49de-bde5-d4474be5ac7a tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6" status: 404 len: 111 microversion: 2.1 time: 0.030194 Jun 15 15:02:42.222619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 549/1116] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:42 2022] GET /compute/v2.1/servers/4ed6135e-cb3c-4138-9a5d-4125acba45d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:42.226796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:42.227310 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:42.233579 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.234065 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.235060 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.235284 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.249326 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: DELETE /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 HTTP/1.1 Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 15:02:42.250856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.252490 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': 'a004c55f-00c1-4c52-9103-f7c287937cd3'} Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:42.254099 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.255586 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.257134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:42.257134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d18c66cb-b8f0-4a4e-9735-ac482176cc38 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 404 len: 111 microversion: 2.1 time: 0.029282 Jun 15 15:02:42.257134 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 568/1117] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:02:42 2022] DELETE /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:02:42.260529 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:42.261169 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: a004c55f-00c1-4c52-9103-f7c287937cd3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:42.267862 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.268310 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.269072 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.269504 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.282612 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 HTTP/1.1 Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 15:02:42.284162 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.285792 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': 'a004c55f-00c1-4c52-9103-f7c287937cd3'} Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:42.286690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. Jun 15 15:02:42.288186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:42.289803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance a004c55f-00c1-4c52-9103-f7c287937cd3 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:42.289803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-efba48de-64f1-489b-8754-4c2d7ecd2f01 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3" status: 404 len: 111 microversion: 2.1 time: 0.028857 Jun 15 15:02:42.289803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 550/1118] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:42 2022] GET /compute/v2.1/servers/a004c55f-00c1-4c52-9103-f7c287937cd3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:43.419392 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:43.419895 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:43.426484 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:43.427025 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:43.427746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:43.428179 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:43.441282 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: DELETE /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf HTTP/1.1 Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 15:02:43.442796 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.444445 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '7ab621e7-097d-4967-b97e-713c90996caf'} Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:43.445283 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.446567 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.447839 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:43.447839 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-376390fa-a3a9-4028-ace4-c103466cab06 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 404 len: 111 microversion: 2.1 time: 0.029258 Jun 15 15:02:43.447839 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 569/1119] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:02:43 2022] DELETE /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:43.452541 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:43.453145 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] [instance: 7ab621e7-097d-4967-b97e-713c90996caf] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:43.459583 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:43.460033 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:43.460782 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:43.461209 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:43.475243 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] HTTP exception thrown: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Request method failure captured: Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf HTTP/1.1 Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfLHxVJ8zaLKYsaMYo0LDTLcvVSmtJm1TsSusmnRjl2fYomBiPusi2n60JENXSrE9jetFryqsK3eCMVky7BeHaKXH-Veg4Fc7l8CUv4wob37LeIm3JGB81230C5siN0MU7y-eQ3EoIeDOhcxtUlzkQ6yK65Qt8USY0BS-RlOSqaI2SQ Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 15:02:43.476774 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9ad78ee5bf484207a38d465c3499b5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 9ad78ee5bf484207a38d465c3499b5d4 Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-241688446 Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1f95ff4743414cbc8cc9a213e508113b Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-241688446-project Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.478370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '7ab621e7-097d-4967-b97e-713c90996caf'} Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:43.479238 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. Jun 15 15:02:43.480607 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:43.482497 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] Returning 404 to user: Instance 7ab621e7-097d-4967-b97e-713c90996caf could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:43.482497 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-879d9dd5-3fc0-4e40-a00b-dd85d56d88f4 tempest-AttachVolumeNegativeTest-241688446 tempest-AttachVolumeNegativeTest-241688446-project] 10.222.0.45 "GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf" status: 404 len: 111 microversion: 2.1 time: 0.029639 Jun 15 15:02:43.482497 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 551/1120] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:43 2022] GET /compute/v2.1/servers/7ab621e7-097d-4967-b97e-713c90996caf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:49.012038 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a6a0171f-6017-4777-a117-f4e0e5d7914f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:49.013803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a6a0171f-6017-4777-a117-f4e0e5d7914f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:49.019013 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-663d48f2-cb01-4f25-8de2-02a45a08499a req-87933428-768b-4212-933e-59fdd76f9308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a517126-ffcc-4783-a8fa-933ac859bddc", "tag": "1bb24e2b-aca5-4f2e-b4c4-df1294f1257a"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:49.022691 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a6a0171f-6017-4777-a117-f4e0e5d7914f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:49.023168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a6a0171f-6017-4777-a117-f4e0e5d7914f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:49.024240 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a6a0171f-6017-4777-a117-f4e0e5d7914f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:49.024898 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a6a0171f-6017-4777-a117-f4e0e5d7914f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:49.031498 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-663d48f2-cb01-4f25-8de2-02a45a08499a req-87933428-768b-4212-933e-59fdd76f9308 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:49.032731 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-663d48f2-cb01-4f25-8de2-02a45a08499a req-87933428-768b-4212-933e-59fdd76f9308 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:49.049024 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-663d48f2-cb01-4f25-8de2-02a45a08499a req-87933428-768b-4212-933e-59fdd76f9308 service nova] Creating event network-changed:1bb24e2b-aca5-4f2e-b4c4-df1294f1257a for instance 9a517126-ffcc-4783-a8fa-933ac859bddc on hv-cinder-80382 Jun 15 15:02:49.055288 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-663d48f2-cb01-4f25-8de2-02a45a08499a req-87933428-768b-4212-933e-59fdd76f9308 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041017 Jun 15 15:02:49.056374 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 552/1121] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:49.060684 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a6a0171f-6017-4777-a117-f4e0e5d7914f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:02:49.152726 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a6a0171f-6017-4777-a117-f4e0e5d7914f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 204 len: 0 microversion: 2.1 time: 0.144789 Jun 15 15:02:49.153945 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 570/1122] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:02:49 2022] DELETE /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:02:49.164396 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-40a441af-c336-40cb-9815-5dfd35f4fd88 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:49.175618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-40a441af-c336-40cb-9815-5dfd35f4fd88 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:49.186593 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40a441af-c336-40cb-9815-5dfd35f4fd88 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:49.189893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40a441af-c336-40cb-9815-5dfd35f4fd88 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:49.190924 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40a441af-c336-40cb-9815-5dfd35f4fd88 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:49.191573 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40a441af-c336-40cb-9815-5dfd35f4fd88 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:49.378141 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-40a441af-c336-40cb-9815-5dfd35f4fd88 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:49.386251 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-40a441af-c336-40cb-9815-5dfd35f4fd88 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1575 microversion: 2.1 time: 0.226512 Jun 15 15:02:49.387255 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 553/1123] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:49 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:50.405799 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-93ccca2f-6941-4330-97f1-5a5db61eb2f8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:50.406596 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-93ccca2f-6941-4330-97f1-5a5db61eb2f8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:50.413213 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-93ccca2f-6941-4330-97f1-5a5db61eb2f8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:50.413745 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-93ccca2f-6941-4330-97f1-5a5db61eb2f8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:50.414590 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-93ccca2f-6941-4330-97f1-5a5db61eb2f8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:50.415125 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-93ccca2f-6941-4330-97f1-5a5db61eb2f8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:50.905340 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-93ccca2f-6941-4330-97f1-5a5db61eb2f8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:50.915267 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-93ccca2f-6941-4330-97f1-5a5db61eb2f8 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1575 microversion: 2.1 time: 0.514121 Jun 15 15:02:50.926746 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 571/1124] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:50 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1575 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:51.490161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-a7442f83-7e28-4d44-9cfc-5fced81e3f5f req-dab99841-c766-42a3-a295-d9cbd73cc53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a517126-ffcc-4783-a8fa-933ac859bddc", "name": "network-vif-deleted", "tag": "1bb24e2b-aca5-4f2e-b4c4-df1294f1257a"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:51.499689 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-a7442f83-7e28-4d44-9cfc-5fced81e3f5f req-dab99841-c766-42a3-a295-d9cbd73cc53c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:51.500136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-a7442f83-7e28-4d44-9cfc-5fced81e3f5f req-dab99841-c766-42a3-a295-d9cbd73cc53c service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:51.511580 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-a7442f83-7e28-4d44-9cfc-5fced81e3f5f req-dab99841-c766-42a3-a295-d9cbd73cc53c service nova] Creating event network-vif-deleted:1bb24e2b-aca5-4f2e-b4c4-df1294f1257a for instance 9a517126-ffcc-4783-a8fa-933ac859bddc on hv-cinder-80382 Jun 15 15:02:51.519193 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-a7442f83-7e28-4d44-9cfc-5fced81e3f5f req-dab99841-c766-42a3-a295-d9cbd73cc53c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031924 Jun 15 15:02:51.520300 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 554/1125] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:51.933720 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:51.935465 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:51.959722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:51.960298 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:51.960925 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:51.961373 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:51.994931 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:51.995404 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:51.995848 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lazy-loading 'fault' on Instance uuid 9a517126-ffcc-4783-a8fa-933ac859bddc {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:02:52.037592 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:52.046497 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d0e1cda5-5ada-4c97-b836-978a3d980938 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 200 len: 1228 microversion: 2.1 time: 0.116346 Jun 15 15:02:52.047097 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 572/1126] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:51 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 1228 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:53.065336 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:53.066021 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 9a517126-ffcc-4783-a8fa-933ac859bddc] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:53.072574 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:53.073026 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:53.073797 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:53.074231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:53.089339 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] HTTP exception thrown: Instance 9a517126-ffcc-4783-a8fa-933ac859bddc could not be found. Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Request method failure captured: Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc HTTP/1.1 Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfKU6wJG9wLonzIApYlNgPd8U2hVvoY2Ys869KCrlEG27Mb5NxXDaYaBHGb0e-zTgS9a9pNzNAMmCTYb-A1SjZhm1NmOvaq6mfk7DLzYJwTBNrqKdBsbBUkXgUUY0tasNmUDwePi1IA1bTBY0GgMO3jUv95ficNV1Jv_H72UmBZitCM Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 15:02:53.090947 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-TestVolumeBootPattern-2042380299-project Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1b23fa0b7fdb4016917987ea1c40af33 Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestVolumeBootPattern-2042380299-project Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance 9a517126-ffcc-4783-a8fa-933ac859bddc could not be found. Jun 15 15:02:53.092684 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '9a517126-ffcc-4783-a8fa-933ac859bddc'} Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a517126-ffcc-4783-a8fa-933ac859bddc could not be found. Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:53.093747 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a517126-ffcc-4783-a8fa-933ac859bddc could not be found. Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a517126-ffcc-4783-a8fa-933ac859bddc could not be found. Jun 15 15:02:53.095515 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:53.097408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Returning 404 to user: Instance 9a517126-ffcc-4783-a8fa-933ac859bddc could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:53.097408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e76ad67c-874b-49db-8a64-cefdd3bbeea4 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc" status: 404 len: 111 microversion: 2.1 time: 0.032015 Jun 15 15:02:53.097408 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 555/1127] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:53 2022] GET /compute/v2.1/servers/9a517126-ffcc-4783-a8fa-933ac859bddc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:56.154271 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-bcda33b2-cbac-4be8-b092-c38c86078309 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:56.154905 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bcda33b2-cbac-4be8-b092-c38c86078309 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:56.157085 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-46fb7719-cc7d-4645-a3b3-ac928ba6ad03 req-52785a8f-47f0-4c68-8ea0-09ef49ea14ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bd87db-4ebd-4703-9ee4-cc662692a9f0", "tag": "582cb652-e0a0-410c-85d7-5df2746fb9d3"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:56.157535 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:56.162491 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bcda33b2-cbac-4be8-b092-c38c86078309 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.163082 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bcda33b2-cbac-4be8-b092-c38c86078309 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.164124 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bcda33b2-cbac-4be8-b092-c38c86078309 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.164763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-bcda33b2-cbac-4be8-b092-c38c86078309 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.165177 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:56.168310 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-46fb7719-cc7d-4645-a3b3-ac928ba6ad03 req-52785a8f-47f0-4c68-8ea0-09ef49ea14ff service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.169066 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-46fb7719-cc7d-4645-a3b3-ac928ba6ad03 req-52785a8f-47f0-4c68-8ea0-09ef49ea14ff service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.169658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:56.173127 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:56.188023 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-46fb7719-cc7d-4645-a3b3-ac928ba6ad03 req-52785a8f-47f0-4c68-8ea0-09ef49ea14ff service nova] Creating event network-changed:582cb652-e0a0-410c-85d7-5df2746fb9d3 for instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 on hv-cinder-80382 Jun 15 15:02:56.194960 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-46fb7719-cc7d-4645-a3b3-ac928ba6ad03 req-52785a8f-47f0-4c68-8ea0-09ef49ea14ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041368 Jun 15 15:02:56.195849 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-bcda33b2-cbac-4be8-b092-c38c86078309 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Going to try to terminate instance {{(pid=124178) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:02:56.196126 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 556/1128] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:56.312457 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-bcda33b2-cbac-4be8-b092-c38c86078309 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "DELETE /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 204 len: 0 microversion: 2.1 time: 0.161447 Jun 15 15:02:56.314040 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 573/1129] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:02:56 2022] DELETE /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:02:56.323393 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ad3136f1-8229-45fa-aa90-0b383ac06d81 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:56.324535 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ad3136f1-8229-45fa-aa90-0b383ac06d81 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:56.332263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad3136f1-8229-45fa-aa90-0b383ac06d81 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.332811 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad3136f1-8229-45fa-aa90-0b383ac06d81 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.334223 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad3136f1-8229-45fa-aa90-0b383ac06d81 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.334735 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad3136f1-8229-45fa-aa90-0b383ac06d81 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.497698 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ad3136f1-8229-45fa-aa90-0b383ac06d81 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:56.505644 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ad3136f1-8229-45fa-aa90-0b383ac06d81 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1575 microversion: 2.1 time: 0.186757 Jun 15 15:02:56.506489 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 557/1130] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:56 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:57.526432 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-65b92f0c-c17c-4d61-b60d-423072556bbd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:57.527280 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-65b92f0c-c17c-4d61-b60d-423072556bbd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:57.535889 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-65b92f0c-c17c-4d61-b60d-423072556bbd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:57.536908 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-65b92f0c-c17c-4d61-b60d-423072556bbd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:57.538043 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-65b92f0c-c17c-4d61-b60d-423072556bbd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:57.539153 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-65b92f0c-c17c-4d61-b60d-423072556bbd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:57.692055 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-65b92f0c-c17c-4d61-b60d-423072556bbd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:57.700768 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-65b92f0c-c17c-4d61-b60d-423072556bbd tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1575 microversion: 2.1 time: 0.180092 Jun 15 15:02:57.708462 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 574/1131] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:57 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:58.616175 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-83341db0-b29f-433a-bdaa-974ae9b6c9fc req-1dea8bd5-c7bf-4faf-8029-d70723932228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bd87db-4ebd-4703-9ee4-cc662692a9f0", "name": "network-vif-deleted", "tag": "582cb652-e0a0-410c-85d7-5df2746fb9d3"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:58.625155 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-83341db0-b29f-433a-bdaa-974ae9b6c9fc req-1dea8bd5-c7bf-4faf-8029-d70723932228 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:58.625602 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-83341db0-b29f-433a-bdaa-974ae9b6c9fc req-1dea8bd5-c7bf-4faf-8029-d70723932228 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:58.636641 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-83341db0-b29f-433a-bdaa-974ae9b6c9fc req-1dea8bd5-c7bf-4faf-8029-d70723932228 service nova] Creating event network-vif-deleted:582cb652-e0a0-410c-85d7-5df2746fb9d3 for instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 on hv-cinder-80382 Jun 15 15:02:58.642256 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-83341db0-b29f-433a-bdaa-974ae9b6c9fc req-1dea8bd5-c7bf-4faf-8029-d70723932228 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029741 Jun 15 15:02:58.643078 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 558/1132] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:58.725437 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ce41f68a-8b7e-42fa-9b00-72c80e4a58d5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:58.726666 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ce41f68a-8b7e-42fa-9b00-72c80e4a58d5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:58.736454 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ce41f68a-8b7e-42fa-9b00-72c80e4a58d5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:58.737016 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ce41f68a-8b7e-42fa-9b00-72c80e4a58d5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:58.737653 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ce41f68a-8b7e-42fa-9b00-72c80e4a58d5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:58.738118 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ce41f68a-8b7e-42fa-9b00-72c80e4a58d5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:58.807400 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ce41f68a-8b7e-42fa-9b00-72c80e4a58d5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23fa0b7fdb4016917987ea1c40af33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59120b6715c1485db0cb1277a52e6c55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:58.816834 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ce41f68a-8b7e-42fa-9b00-72c80e4a58d5 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 200 len: 1223 microversion: 2.1 time: 0.095774 Jun 15 15:02:58.817396 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 575/1133] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:58 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:59.227174 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:02:59.227399 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Wed Jun 15 15:02:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:02:59.618736 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:02:59.618939 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Wed Jun 15 15:02:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:02:59.834584 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:59.835409 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 30bd87db-4ebd-4703-9ee4-cc662692a9f0] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:59.841708 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:59.842224 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:59.843028 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:59.843469 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:59.857970 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] HTTP exception thrown: Instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 could not be found. Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Request method failure captured: Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 HTTP/1.1 Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfKU6wJG9wLonzIApYlNgPd8U2hVvoY2Ys869KCrlEG27Mb5NxXDaYaBHGb0e-zTgS9a9pNzNAMmCTYb-A1SjZhm1NmOvaq6mfk7DLzYJwTBNrqKdBsbBUkXgUUY0tasNmUDwePi1IA1bTBY0GgMO3jUv95ficNV1Jv_H72UmBZitCM Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 15:02:59.859562 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-TestVolumeBootPattern-2042380299-project Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1b23fa0b7fdb4016917987ea1c40af33 Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestVolumeBootPattern-2042380299-project Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 could not be found. Jun 15 15:02:59.860893 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '30bd87db-4ebd-4703-9ee4-cc662692a9f0'} Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 could not be found. Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:59.861664 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 could not be found. Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 could not be found. Jun 15 15:02:59.863011 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:02:59.864202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Returning 404 to user: Instance 30bd87db-4ebd-4703-9ee4-cc662692a9f0 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:59.864202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0b56660e-5a00-4006-bf65-b13ad2b4267f tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0" status: 404 len: 111 microversion: 2.1 time: 0.031378 Jun 15 15:02:59.864202 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 559/1134] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:59 2022] GET /compute/v2.1/servers/30bd87db-4ebd-4703-9ee4-cc662692a9f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:00.301870 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:00.302366 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:00.309298 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.309747 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.310500 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.310932 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.323836 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] HTTP exception thrown: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Request method failure captured: Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: DELETE /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 HTTP/1.1 Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfKU6wJG9wLonzIApYlNgPd8U2hVvoY2Ys869KCrlEG27Mb5NxXDaYaBHGb0e-zTgS9a9pNzNAMmCTYb-A1SjZhm1NmOvaq6mfk7DLzYJwTBNrqKdBsbBUkXgUUY0tasNmUDwePi1IA1bTBY0GgMO3jUv95ficNV1Jv_H72UmBZitCM Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 15:03:00.325983 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-TestVolumeBootPattern-2042380299-project Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: 1b23fa0b7fdb4016917987ea1c40af33 Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-TestVolumeBootPattern-2042380299-project Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.327640 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '7c62c5ab-613d-4a52-95e0-7ffe043a9628'} Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:00.328509 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.330029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.331578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Returning 404 to user: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:00.331578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-dd17fc6d-a334-4f32-a135-604aa6432b40 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 404 len: 111 microversion: 2.1 time: 0.029318 Jun 15 15:03:00.331578 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 576/1135] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:03:00 2022] DELETE /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:00.336434 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:00.337039 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] [instance: 7c62c5ab-613d-4a52-95e0-7ffe043a9628] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:00.343621 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.344067 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.344815 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.345246 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.358467 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] HTTP exception thrown: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Request method failure captured: Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 HTTP/1.1 Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Connection: close Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Host: 10.222.0.45 Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABiqfKU6wJG9wLonzIApYlNgPd8U2hVvoY2Ys869KCrlEG27Mb5NxXDaYaBHGb0e-zTgS9a9pNzNAMmCTYb-A1SjZhm1NmOvaq6mfk7DLzYJwTBNrqKdBsbBUkXgUUY0tasNmUDwePi1IA1bTBY0GgMO3jUv95ficNV1Jv_H72UmBZitCM Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Role: reader,member Jun 15 15:03:00.360009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Roles: reader,member Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/59120b6715c1485db0cb1277a52e6c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 59120b6715c1485db0cb1277a52e6c55 Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042380299 Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User: tempest-TestVolumeBootPattern-2042380299-project Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Id: 1b23fa0b7fdb4016917987ea1c40af33 Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestVolumeBootPattern-2042380299-project Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: method: > Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: exception: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.361668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: action_args: {'id': '7c62c5ab-613d-4a52-95e0-7ffe043a9628'} Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:00.362662 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. Jun 15 15:03:00.364287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 15 15:03:00.366075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Returning 404 to user: Instance 7c62c5ab-613d-4a52-95e0-7ffe043a9628 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:00.366075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ac7d0072-c0e2-4d0e-92e7-4cb390344176 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628" status: 404 len: 111 microversion: 2.1 time: 0.028860 Jun 15 15:03:00.366075 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 560/1136] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:00 2022] GET /compute/v2.1/servers/7c62c5ab-613d-4a52-95e0-7ffe043a9628 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:01.655849 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-d7821295-f42c-4c75-8380-f7c4d2472e33 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] Calling method '.version_select at 0x7f05bc078790>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:01.682233 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-d7821295-f42c-4c75-8380-f7c4d2472e33 tempest-TestVolumeBootPattern-2042380299 tempest-TestVolumeBootPattern-2042380299-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-35110241" status: 202 len: 0 microversion: 2.1 time: 0.031723 Jun 15 15:03:01.682812 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 577/1137] 10.222.0.45 () {58 vars in 1256 bytes} [Wed Jun 15 15:03:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-35110241 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:03:26.974460 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6e517a43-7855-41b7-93d8-b1734b88e27f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Action: 'create', calling method: .version_select at 0x7f05b77ca160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1757897064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuded4qwgkXKlmG6+BUlcu1I1La6Ai2luPhyoZagMKVcE4qfDPQMAEzfE5Ye5isA7FbkZHxM97wR9s2JZjFZZudunp5//5io5S7J6eqBLKS21juVCzpwth8fybfXVqXeg=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:26.978611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=9 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:26.979351 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=13 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:26.991287 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-6e517a43-7855-41b7-93d8-b1734b88e27f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Getting quotas for project c54a1f9aea1a42bfb5fc36770120eb58. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:03:26.995081 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-6e517a43-7855-41b7-93d8-b1734b88e27f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Getting quotas for user abf3c553d53f4118a2b4bb6ba27debe5 and project c54a1f9aea1a42bfb5fc36770120eb58. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:03:27.017561 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6e517a43-7855-41b7-93d8-b1734b88e27f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047097 Jun 15 15:03:27.018161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 561/1138] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Jun 15 15:03:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:27.064075 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:27.064823 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:27.069736 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1203478760", "imageRef": "1fa2b387-93de-4e84-8f3c-cf3ee7da4a64", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1757897064", "networks": [{"uuid": "773c94b5-2b4d-4f26-941b-bd1bf3c7a765"}]}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:27.122381 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.network.neutron [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] validate_networks() for [('773c94b5-2b4d-4f26-941b-bd1bf3c7a765', None, None, None, None, None)] {{(pid=124178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:03:27.486443 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Flavor limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:03:27.486811 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Image limits 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:03:27.487343 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Flavor pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:03:27.487757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Image pref 0:0:0 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:03:27.488168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.virt.hardware [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:03:27.496937 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:27.497883 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:27.498677 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:27.499164 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:27.515358 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Getting quotas for project c54a1f9aea1a42bfb5fc36770120eb58. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:03:27.519223 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.quota [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Getting quotas for user abf3c553d53f4118a2b4bb6ba27debe5 and project c54a1f9aea1a42bfb5fc36770120eb58. Resources: {'cores', 'ram', 'instances'} {{(pid=124178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:03:27.529797 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Going to run 1 instances... {{(pid=124178) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:03:27.531982 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fa2b387-93de-4e84-8f3c-cf3ee7da4a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:03:27.577670 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1803a020-7e31-4de3-a205-4fb0b6b96ed3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515041 Jun 15 15:03:27.578308 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 578/1139] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Jun 15 15:03:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:03:27.587914 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-edd40b4b-fc39-4e09-9fbd-6aa7a3200c56 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:27.588525 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-edd40b4b-fc39-4e09-9fbd-6aa7a3200c56 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:27.819211 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-edd40b4b-fc39-4e09-9fbd-6aa7a3200c56 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:27.826765 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-edd40b4b-fc39-4e09-9fbd-6aa7a3200c56 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1259 microversion: 2.1 time: 0.242678 Jun 15 15:03:27.827362 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 562/1140] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:27 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1259 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:28.844212 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-cb6b903d-9af5-43be-ab4d-88fa68232f9a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:28.844831 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-cb6b903d-9af5-43be-ab4d-88fa68232f9a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:28.851596 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cb6b903d-9af5-43be-ab4d-88fa68232f9a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:28.852051 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cb6b903d-9af5-43be-ab4d-88fa68232f9a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:28.852856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cb6b903d-9af5-43be-ab4d-88fa68232f9a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:28.853493 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-cb6b903d-9af5-43be-ab4d-88fa68232f9a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:28.919696 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-cb6b903d-9af5-43be-ab4d-88fa68232f9a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:28.928425 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-cb6b903d-9af5-43be-ab4d-88fa68232f9a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1317 microversion: 2.1 time: 0.088536 Jun 15 15:03:28.929198 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 579/1141] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:28 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1317 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:29.946616 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-52d62981-19f4-469a-afa0-7679a3670929 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:29.948172 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-52d62981-19f4-469a-afa0-7679a3670929 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:29.955795 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52d62981-19f4-469a-afa0-7679a3670929 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:29.956349 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52d62981-19f4-469a-afa0-7679a3670929 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:29.957349 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52d62981-19f4-469a-afa0-7679a3670929 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:29.957858 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52d62981-19f4-469a-afa0-7679a3670929 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:30.093009 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-52d62981-19f4-469a-afa0-7679a3670929 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:30.100683 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-52d62981-19f4-469a-afa0-7679a3670929 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.158661 Jun 15 15:03:30.111275 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 563/1142] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:29 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:31.119379 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a5050186-8f4c-4d3f-94e9-8902dff01a52 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:31.119956 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a5050186-8f4c-4d3f-94e9-8902dff01a52 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:31.126842 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5050186-8f4c-4d3f-94e9-8902dff01a52 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:31.127322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5050186-8f4c-4d3f-94e9-8902dff01a52 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:31.128089 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5050186-8f4c-4d3f-94e9-8902dff01a52 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:31.128533 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a5050186-8f4c-4d3f-94e9-8902dff01a52 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:31.264516 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a5050186-8f4c-4d3f-94e9-8902dff01a52 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:31.272838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a5050186-8f4c-4d3f-94e9-8902dff01a52 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.158745 Jun 15 15:03:31.273650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 580/1143] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:31 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:32.291184 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-185027e5-d8ed-4b1a-87eb-e7095b8663d3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:32.291968 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-185027e5-d8ed-4b1a-87eb-e7095b8663d3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:32.298812 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-185027e5-d8ed-4b1a-87eb-e7095b8663d3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.299290 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-185027e5-d8ed-4b1a-87eb-e7095b8663d3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.300064 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-185027e5-d8ed-4b1a-87eb-e7095b8663d3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.300500 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-185027e5-d8ed-4b1a-87eb-e7095b8663d3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.443964 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-185027e5-d8ed-4b1a-87eb-e7095b8663d3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:32.451867 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-185027e5-d8ed-4b1a-87eb-e7095b8663d3 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.164588 Jun 15 15:03:32.456619 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 564/1144] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:32 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:33.469413 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-177def95-c2fd-46a4-a064-6a8d1ca9bf30 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:33.470120 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-177def95-c2fd-46a4-a064-6a8d1ca9bf30 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:33.479169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-177def95-c2fd-46a4-a064-6a8d1ca9bf30 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:33.479780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-177def95-c2fd-46a4-a064-6a8d1ca9bf30 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:33.480558 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-177def95-c2fd-46a4-a064-6a8d1ca9bf30 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:33.480970 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-177def95-c2fd-46a4-a064-6a8d1ca9bf30 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:33.623106 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-177def95-c2fd-46a4-a064-6a8d1ca9bf30 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:33.630966 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-177def95-c2fd-46a4-a064-6a8d1ca9bf30 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.166015 Jun 15 15:03:33.631769 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 581/1145] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:33 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:34.647728 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-aabeea35-8c7b-478b-99d9-0147b7a24bce tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:34.648354 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-aabeea35-8c7b-478b-99d9-0147b7a24bce tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:34.655865 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aabeea35-8c7b-478b-99d9-0147b7a24bce tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.656310 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aabeea35-8c7b-478b-99d9-0147b7a24bce tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:34.657076 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aabeea35-8c7b-478b-99d9-0147b7a24bce tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.657519 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aabeea35-8c7b-478b-99d9-0147b7a24bce tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:34.808594 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-aabeea35-8c7b-478b-99d9-0147b7a24bce tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:34.816276 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-aabeea35-8c7b-478b-99d9-0147b7a24bce tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.172342 Jun 15 15:03:34.816943 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 565/1146] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:34 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:35.833533 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6987d5fd-97a7-4792-a35a-015c08147e54 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:35.834168 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6987d5fd-97a7-4792-a35a-015c08147e54 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:35.841334 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6987d5fd-97a7-4792-a35a-015c08147e54 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:35.841778 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6987d5fd-97a7-4792-a35a-015c08147e54 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:35.842537 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6987d5fd-97a7-4792-a35a-015c08147e54 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:35.842963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6987d5fd-97a7-4792-a35a-015c08147e54 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:35.979050 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6987d5fd-97a7-4792-a35a-015c08147e54 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:35.988254 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6987d5fd-97a7-4792-a35a-015c08147e54 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.158303 Jun 15 15:03:35.998286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 582/1147] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:35 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:37.005639 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-42fd76fa-db28-415d-9664-1f8fd0e8970d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:37.006225 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-42fd76fa-db28-415d-9664-1f8fd0e8970d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:37.012764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-42fd76fa-db28-415d-9664-1f8fd0e8970d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:37.013231 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-42fd76fa-db28-415d-9664-1f8fd0e8970d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:37.013985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-42fd76fa-db28-415d-9664-1f8fd0e8970d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:37.014420 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-42fd76fa-db28-415d-9664-1f8fd0e8970d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:37.139481 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-42fd76fa-db28-415d-9664-1f8fd0e8970d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:37.146835 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-42fd76fa-db28-415d-9664-1f8fd0e8970d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.145194 Jun 15 15:03:37.147428 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 566/1148] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:37 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:38.163832 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-ea0a2698-9829-4aea-934a-658649f40f39 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:38.164475 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-ea0a2698-9829-4aea-934a-658649f40f39 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:38.166757 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:38.167462 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=6 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:38.173266 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ea0a2698-9829-4aea-934a-658649f40f39 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.173714 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ea0a2698-9829-4aea-934a-658649f40f39 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.174471 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ea0a2698-9829-4aea-934a-658649f40f39 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.174948 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-ea0a2698-9829-4aea-934a-658649f40f39 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.301948 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-ea0a2698-9829-4aea-934a-658649f40f39 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:38.309316 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-ea0a2698-9829-4aea-934a-658649f40f39 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.149352 Jun 15 15:03:38.309874 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 583/1149] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:38 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:39.326732 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b9a190ab-e80a-4cb5-ad5c-3c6ce98aab19 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:39.327400 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b9a190ab-e80a-4cb5-ad5c-3c6ce98aab19 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:39.329263 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:39.335104 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9a190ab-e80a-4cb5-ad5c-3c6ce98aab19 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:39.335547 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9a190ab-e80a-4cb5-ad5c-3c6ce98aab19 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:39.336305 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9a190ab-e80a-4cb5-ad5c-3c6ce98aab19 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:39.336734 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9a190ab-e80a-4cb5-ad5c-3c6ce98aab19 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:39.465267 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b9a190ab-e80a-4cb5-ad5c-3c6ce98aab19 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:39.473582 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b9a190ab-e80a-4cb5-ad5c-3c6ce98aab19 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.151248 Jun 15 15:03:39.474157 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 567/1150] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:39 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:39.976583 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-0106275c-bd1d-4810-9cf6-8fc57b413293 req-494bc61d-cedb-4a3f-bedb-2aaf3dede86b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200da5f3-ea4d-4131-94c1-963bb07e5329", "tag": "9be08a1a-7a01-47e6-aa5c-f02bf206b61f"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:40.002588 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-0106275c-bd1d-4810-9cf6-8fc57b413293 req-494bc61d-cedb-4a3f-bedb-2aaf3dede86b service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:40.003324 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-0106275c-bd1d-4810-9cf6-8fc57b413293 req-494bc61d-cedb-4a3f-bedb-2aaf3dede86b service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:40.018902 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-0106275c-bd1d-4810-9cf6-8fc57b413293 req-494bc61d-cedb-4a3f-bedb-2aaf3dede86b service nova] Creating event network-changed:9be08a1a-7a01-47e6-aa5c-f02bf206b61f for instance 200da5f3-ea4d-4131-94c1-963bb07e5329 on hv-cinder-80382 Jun 15 15:03:40.026068 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-0106275c-bd1d-4810-9cf6-8fc57b413293 req-494bc61d-cedb-4a3f-bedb-2aaf3dede86b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059350 Jun 15 15:03:40.026667 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 584/1151] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:40.490221 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b2a1af1e-da1d-4b08-8778-af444eab843e tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:40.490838 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b2a1af1e-da1d-4b08-8778-af444eab843e tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:40.497666 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2a1af1e-da1d-4b08-8778-af444eab843e tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:40.498225 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2a1af1e-da1d-4b08-8778-af444eab843e tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:40.498940 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2a1af1e-da1d-4b08-8778-af444eab843e tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:40.499456 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2a1af1e-da1d-4b08-8778-af444eab843e tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:40.628910 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b2a1af1e-da1d-4b08-8778-af444eab843e tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:40.636184 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b2a1af1e-da1d-4b08-8778-af444eab843e tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.149987 Jun 15 15:03:40.636745 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 568/1152] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:40 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:41.654633 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-20e39d27-f32b-48f2-920d-3e6a1275dcac tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:41.655373 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-20e39d27-f32b-48f2-920d-3e6a1275dcac tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:41.662324 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-20e39d27-f32b-48f2-920d-3e6a1275dcac tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:41.662984 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-20e39d27-f32b-48f2-920d-3e6a1275dcac tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:41.663939 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-20e39d27-f32b-48f2-920d-3e6a1275dcac tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:41.664442 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-20e39d27-f32b-48f2-920d-3e6a1275dcac tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:41.793330 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-20e39d27-f32b-48f2-920d-3e6a1275dcac tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:41.801559 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-20e39d27-f32b-48f2-920d-3e6a1275dcac tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.152049 Jun 15 15:03:41.802124 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 585/1153] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:41 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:42.817712 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c4cf4289-326d-478c-ae92-5205d5c506e4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:42.818317 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c4cf4289-326d-478c-ae92-5205d5c506e4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:42.824681 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c4cf4289-326d-478c-ae92-5205d5c506e4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:42.825136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c4cf4289-326d-478c-ae92-5205d5c506e4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:42.825904 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c4cf4289-326d-478c-ae92-5205d5c506e4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:42.826925 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c4cf4289-326d-478c-ae92-5205d5c506e4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:42.957539 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c4cf4289-326d-478c-ae92-5205d5c506e4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:42.964985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c4cf4289-326d-478c-ae92-5205d5c506e4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.151223 Jun 15 15:03:42.965552 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 569/1154] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:42 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:43.981551 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-fbada341-599b-4629-aa4b-15d34fe1ac0b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:43.982092 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-fbada341-599b-4629-aa4b-15d34fe1ac0b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:43.989084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fbada341-599b-4629-aa4b-15d34fe1ac0b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:43.989523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fbada341-599b-4629-aa4b-15d34fe1ac0b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:43.990266 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fbada341-599b-4629-aa4b-15d34fe1ac0b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:43.990722 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-fbada341-599b-4629-aa4b-15d34fe1ac0b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:44.115408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-fbada341-599b-4629-aa4b-15d34fe1ac0b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:44.122700 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-fbada341-599b-4629-aa4b-15d34fe1ac0b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.145056 Jun 15 15:03:44.123286 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 586/1155] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:43 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:45.139976 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6232fc68-6a37-4494-869a-12672b2f889b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:45.140580 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6232fc68-6a37-4494-869a-12672b2f889b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:45.146960 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6232fc68-6a37-4494-869a-12672b2f889b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.147428 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6232fc68-6a37-4494-869a-12672b2f889b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:45.148180 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6232fc68-6a37-4494-869a-12672b2f889b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.148608 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6232fc68-6a37-4494-869a-12672b2f889b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:45.275390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6232fc68-6a37-4494-869a-12672b2f889b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:45.282766 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6232fc68-6a37-4494-869a-12672b2f889b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.147274 Jun 15 15:03:45.283370 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 570/1156] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:45 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:46.299858 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6090d386-1023-4269-8d44-7ec804415af4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:46.300473 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6090d386-1023-4269-8d44-7ec804415af4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:46.306763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6090d386-1023-4269-8d44-7ec804415af4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:46.307252 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6090d386-1023-4269-8d44-7ec804415af4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:46.308022 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6090d386-1023-4269-8d44-7ec804415af4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:46.308464 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6090d386-1023-4269-8d44-7ec804415af4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:46.344237 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-0e8b83cf-3af0-46a6-9963-96a01c89d97b req-785ebd04-bf9d-422d-91e2-fbc2bc4f0eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200da5f3-ea4d-4131-94c1-963bb07e5329", "name": "network-vif-plugged", "status": "completed", "tag": "9be08a1a-7a01-47e6-aa5c-f02bf206b61f"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:46.354983 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-0e8b83cf-3af0-46a6-9963-96a01c89d97b req-785ebd04-bf9d-422d-91e2-fbc2bc4f0eb7 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:46.355484 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-0e8b83cf-3af0-46a6-9963-96a01c89d97b req-785ebd04-bf9d-422d-91e2-fbc2bc4f0eb7 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:46.367340 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-0e8b83cf-3af0-46a6-9963-96a01c89d97b req-785ebd04-bf9d-422d-91e2-fbc2bc4f0eb7 service nova] Creating event network-vif-plugged:9be08a1a-7a01-47e6-aa5c-f02bf206b61f for instance 200da5f3-ea4d-4131-94c1-963bb07e5329 on hv-cinder-80382 Jun 15 15:03:46.372458 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-0e8b83cf-3af0-46a6-9963-96a01c89d97b req-785ebd04-bf9d-422d-91e2-fbc2bc4f0eb7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032165 Jun 15 15:03:46.373058 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 571/1157] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:03:46.445071 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6090d386-1023-4269-8d44-7ec804415af4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:46.454511 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6090d386-1023-4269-8d44-7ec804415af4 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.158827 Jun 15 15:03:46.455109 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 587/1158] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:46 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:47.472819 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f9730178-d81d-484c-8af6-adb7d7687ef9 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:47.473504 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f9730178-d81d-484c-8af6-adb7d7687ef9 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:47.479883 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9730178-d81d-484c-8af6-adb7d7687ef9 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:47.480326 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9730178-d81d-484c-8af6-adb7d7687ef9 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:47.481073 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9730178-d81d-484c-8af6-adb7d7687ef9 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:47.481503 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9730178-d81d-484c-8af6-adb7d7687ef9 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:47.606638 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f9730178-d81d-484c-8af6-adb7d7687ef9 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:47.613968 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f9730178-d81d-484c-8af6-adb7d7687ef9 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1359 microversion: 2.1 time: 0.146540 Jun 15 15:03:47.614555 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 572/1159] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:47 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:48.630820 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-531529a9-e0a4-43ec-abee-434ebf93a757 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:48.631460 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-531529a9-e0a4-43ec-abee-434ebf93a757 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:48.638386 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-531529a9-e0a4-43ec-abee-434ebf93a757 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:48.638843 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-531529a9-e0a4-43ec-abee-434ebf93a757 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:48.639631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-531529a9-e0a4-43ec-abee-434ebf93a757 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:48.640072 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-531529a9-e0a4-43ec-abee-434ebf93a757 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:48.769887 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-531529a9-e0a4-43ec-abee-434ebf93a757 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:48.777396 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-531529a9-e0a4-43ec-abee-434ebf93a757 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1548 microversion: 2.1 time: 0.150598 Jun 15 15:03:48.777963 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 588/1160] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:48 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:48.793500 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a0b49386-93b3-4333-aa2c-10613962a8cc tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:48.794107 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a0b49386-93b3-4333-aa2c-10613962a8cc tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:48.801686 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0b49386-93b3-4333-aa2c-10613962a8cc tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:48.802136 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0b49386-93b3-4333-aa2c-10613962a8cc tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:48.802895 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0b49386-93b3-4333-aa2c-10613962a8cc tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:48.803357 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0b49386-93b3-4333-aa2c-10613962a8cc tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:48.929220 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a0b49386-93b3-4333-aa2c-10613962a8cc tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:48.936985 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a0b49386-93b3-4333-aa2c-10613962a8cc tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1548 microversion: 2.1 time: 0.147282 Jun 15 15:03:48.937542 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 573/1161] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:48 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:48.953184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-831075b0-d2a4-4f2b-9788-2067eaf33d51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:48.956671 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-831075b0-d2a4-4f2b-9788-2067eaf33d51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:48.957435 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-831075b0-d2a4-4f2b-9788-2067eaf33d51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Searching by: {'deleted': False, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58'} {{(pid=124178) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 15:03:48.963976 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-831075b0-d2a4-4f2b-9788-2067eaf33d51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:48.964420 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-831075b0-d2a4-4f2b-9788-2067eaf33d51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:48.965204 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-831075b0-d2a4-4f2b-9788-2067eaf33d51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:48.965631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-831075b0-d2a4-4f2b-9788-2067eaf33d51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:49.053589 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.multi_cell_list [None req-831075b0-d2a4-4f2b-9788-2067eaf33d51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124178) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 15:03:49.143602 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-831075b0-d2a4-4f2b-9788-2067eaf33d51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.194662 Jun 15 15:03:49.144178 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 589/1162] 10.222.0.45 () {58 vars in 1124 bytes} [Wed Jun 15 15:03:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:49.154343 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-43638d9b-1142-4f69-8ad9-53f01adff453 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:49.155891 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-43638d9b-1142-4f69-8ad9-53f01adff453 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:49.162001 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-43638d9b-1142-4f69-8ad9-53f01adff453 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:49.162444 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-43638d9b-1142-4f69-8ad9-53f01adff453 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:49.163234 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-43638d9b-1142-4f69-8ad9-53f01adff453 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:49.163668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-43638d9b-1142-4f69-8ad9-53f01adff453 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:49.294943 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-43638d9b-1142-4f69-8ad9-53f01adff453 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:49.303109 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-43638d9b-1142-4f69-8ad9-53f01adff453 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1548 microversion: 2.1 time: 0.152609 Jun 15 15:03:49.303668 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 574/1163] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:49 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:50.800588 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-80637704-786c-4d4f-a529-c3aaca65580a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38df820e-c956-4121-90f5-fb102bbba99c"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:50.801649 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-80637704-786c-4d4f-a529-c3aaca65580a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:50.808094 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-80637704-786c-4d4f-a529-c3aaca65580a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:50.808547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-80637704-786c-4d4f-a529-c3aaca65580a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:50.809302 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-80637704-786c-4d4f-a529-c3aaca65580a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:50.809734 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-80637704-786c-4d4f-a529-c3aaca65580a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:51.057516 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-80637704-786c-4d4f-a529-c3aaca65580a tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "POST /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260952 Jun 15 15:03:51.058123 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 590/1164] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Jun 15 15:03:50 2022] POST /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:58.575175 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-94283f63-4519-4c4e-8657-0b3ceaa4262f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:58.575781 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-94283f63-4519-4c4e-8657-0b3ceaa4262f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:58.577948 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:58.583524 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94283f63-4519-4c4e-8657-0b3ceaa4262f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:58.583999 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94283f63-4519-4c4e-8657-0b3ceaa4262f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:58.584754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94283f63-4519-4c4e-8657-0b3ceaa4262f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:58.585185 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94283f63-4519-4c4e-8657-0b3ceaa4262f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:58.590172 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=69 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:58.718906 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-94283f63-4519-4c4e-8657-0b3ceaa4262f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:58.727549 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-94283f63-4519-4c4e-8657-0b3ceaa4262f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1594 microversion: 2.1 time: 0.156426 Jun 15 15:03:58.728117 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 575/1165] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:58 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:00.310322 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell0:SELECT=2 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:00.314674 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-90a4b516-479b-4160-8574-128765402136 req-12812d7a-ad3a-41f0-9c4e-52f568ac7184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200da5f3-ea4d-4131-94c1-963bb07e5329", "tag": "9be08a1a-7a01-47e6-aa5c-f02bf206b61f"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:00.318673 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:00.325725 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-90a4b516-479b-4160-8574-128765402136 req-12812d7a-ad3a-41f0-9c4e-52f568ac7184 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:00.326399 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-90a4b516-479b-4160-8574-128765402136 req-12812d7a-ad3a-41f0-9c4e-52f568ac7184 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:00.330246 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:00.340520 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-90a4b516-479b-4160-8574-128765402136 req-12812d7a-ad3a-41f0-9c4e-52f568ac7184 service nova] Creating event network-changed:9be08a1a-7a01-47e6-aa5c-f02bf206b61f for instance 200da5f3-ea4d-4131-94c1-963bb07e5329 on hv-cinder-80382 Jun 15 15:04:00.346184 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-90a4b516-479b-4160-8574-128765402136 req-12812d7a-ad3a-41f0-9c4e-52f568ac7184 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037183 Jun 15 15:04:00.347101 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 591/1166] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:01.596240 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-11db79da-35f9-4ba7-b1d1-2335ed6496d6 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1775569984"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:01.596783 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-11db79da-35f9-4ba7-b1d1-2335ed6496d6 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:01.603307 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11db79da-35f9-4ba7-b1d1-2335ed6496d6 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:01.603743 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11db79da-35f9-4ba7-b1d1-2335ed6496d6 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:01.604505 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11db79da-35f9-4ba7-b1d1-2335ed6496d6 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:01.604942 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11db79da-35f9-4ba7-b1d1-2335ed6496d6 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:01.732285 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.network.security_group_api [None req-11db79da-35f9-4ba7-b1d1-2335ed6496d6 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Adding security group 616af9e6-89db-41b1-ace7-78fc38a4ccfc to port 9be08a1a-7a01-47e6-aa5c-f02bf206b61f Jun 15 15:04:02.080654 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-11db79da-35f9-4ba7-b1d1-2335ed6496d6 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "POST /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/action" status: 202 len: 0 microversion: 2.1 time: 0.488345 Jun 15 15:04:02.081771 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 576/1167] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 15:04:01 2022] POST /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:04:02.091803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-69bac6e2-6405-4e81-9e2b-bfd74eeb053c tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:02.093086 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-69bac6e2-6405-4e81-9e2b-bfd74eeb053c tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:02.101173 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-69bac6e2-6405-4e81-9e2b-bfd74eeb053c tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:02.101624 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-69bac6e2-6405-4e81-9e2b-bfd74eeb053c tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:02.102391 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-69bac6e2-6405-4e81-9e2b-bfd74eeb053c tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:02.103020 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-69bac6e2-6405-4e81-9e2b-bfd74eeb053c tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:02.262659 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-69bac6e2-6405-4e81-9e2b-bfd74eeb053c tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:02.270623 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-69bac6e2-6405-4e81-9e2b-bfd74eeb053c tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1759 microversion: 2.1 time: 0.184765 Jun 15 15:04:02.283248 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 592/1168] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:02 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:02.362252 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-e1868671-b34d-46d6-8779-eecdbaca6eb5 req-6b6f54e7-9818-4465-bd88-95f370f8af4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200da5f3-ea4d-4131-94c1-963bb07e5329", "tag": "9be08a1a-7a01-47e6-aa5c-f02bf206b61f"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:02.370387 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-e1868671-b34d-46d6-8779-eecdbaca6eb5 req-6b6f54e7-9818-4465-bd88-95f370f8af4b service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:02.370887 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-e1868671-b34d-46d6-8779-eecdbaca6eb5 req-6b6f54e7-9818-4465-bd88-95f370f8af4b service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:02.381869 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-e1868671-b34d-46d6-8779-eecdbaca6eb5 req-6b6f54e7-9818-4465-bd88-95f370f8af4b service nova] Creating event network-changed:9be08a1a-7a01-47e6-aa5c-f02bf206b61f for instance 200da5f3-ea4d-4131-94c1-963bb07e5329 on hv-cinder-80382 Jun 15 15:04:02.387530 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-e1868671-b34d-46d6-8779-eecdbaca6eb5 req-6b6f54e7-9818-4465-bd88-95f370f8af4b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029461 Jun 15 15:04:02.388537 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 577/1169] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:30.360923 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:04:30.361580 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 15:04:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:05:02.800517 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=3 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:02.801285 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=7 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:02.805705 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-79dd4aaa-fb64-4d76-bd35-f80fb6895ca5 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:02.806716 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-79dd4aaa-fb64-4d76-bd35-f80fb6895ca5 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:02.812907 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-79dd4aaa-fb64-4d76-bd35-f80fb6895ca5 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:02.813366 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-79dd4aaa-fb64-4d76-bd35-f80fb6895ca5 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:02.814137 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-79dd4aaa-fb64-4d76-bd35-f80fb6895ca5 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:02.814575 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-79dd4aaa-fb64-4d76-bd35-f80fb6895ca5 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:02.890655 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-79dd4aaa-fb64-4d76-bd35-f80fb6895ca5 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "POST /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/action" status: 202 len: 0 microversion: 2.1 time: 0.091899 Jun 15 15:05:02.891564 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 593/1170] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 15:05:02 2022] POST /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:05:02.898383 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=5 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:02.899213 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=11 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:02.904845 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ee8b4e7d-26b4-4973-81db-6ba71c770f5b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:02.905537 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ee8b4e7d-26b4-4973-81db-6ba71c770f5b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:02.913235 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee8b4e7d-26b4-4973-81db-6ba71c770f5b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:02.914578 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee8b4e7d-26b4-4973-81db-6ba71c770f5b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:02.915679 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee8b4e7d-26b4-4973-81db-6ba71c770f5b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:02.916214 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ee8b4e7d-26b4-4973-81db-6ba71c770f5b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:03.074504 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ee8b4e7d-26b4-4973-81db-6ba71c770f5b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:03.082528 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ee8b4e7d-26b4-4973-81db-6ba71c770f5b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1751 microversion: 2.1 time: 0.186720 Jun 15 15:05:03.083111 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 578/1171] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:02 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:04.101272 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8ea736f0-49a0-4789-a85a-7612a1193e17 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:04.101973 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8ea736f0-49a0-4789-a85a-7612a1193e17 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:04.108201 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8ea736f0-49a0-4789-a85a-7612a1193e17 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:04.108652 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8ea736f0-49a0-4789-a85a-7612a1193e17 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:04.109408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8ea736f0-49a0-4789-a85a-7612a1193e17 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:04.109851 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8ea736f0-49a0-4789-a85a-7612a1193e17 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:04.252863 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8ea736f0-49a0-4789-a85a-7612a1193e17 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:04.260650 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8ea736f0-49a0-4789-a85a-7612a1193e17 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1756 microversion: 2.1 time: 0.164109 Jun 15 15:05:04.261214 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 594/1172] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:04 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:05.278138 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6f3d44cd-a392-4437-9320-00ba09637ffe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:05.278754 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6f3d44cd-a392-4437-9320-00ba09637ffe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:05.285448 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f3d44cd-a392-4437-9320-00ba09637ffe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:05.285899 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f3d44cd-a392-4437-9320-00ba09637ffe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:05.286667 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f3d44cd-a392-4437-9320-00ba09637ffe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:05.287138 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f3d44cd-a392-4437-9320-00ba09637ffe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:05.432289 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6f3d44cd-a392-4437-9320-00ba09637ffe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:05.440279 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6f3d44cd-a392-4437-9320-00ba09637ffe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1756 microversion: 2.1 time: 0.166095 Jun 15 15:05:05.440842 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 579/1173] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:05 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:06.457717 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-8807f375-96b6-4265-b73a-4bd9cccad2eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:06.458325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-8807f375-96b6-4265-b73a-4bd9cccad2eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:06.464786 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8807f375-96b6-4265-b73a-4bd9cccad2eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:06.465234 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8807f375-96b6-4265-b73a-4bd9cccad2eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:06.465986 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8807f375-96b6-4265-b73a-4bd9cccad2eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:06.466422 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-8807f375-96b6-4265-b73a-4bd9cccad2eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:06.603780 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-8807f375-96b6-4265-b73a-4bd9cccad2eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:06.611645 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-8807f375-96b6-4265-b73a-4bd9cccad2eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1756 microversion: 2.1 time: 0.157837 Jun 15 15:05:06.612203 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 595/1174] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:06 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:07.628814 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fb52de3f-73ee-4d2c-aa48-5cd39ca5d6ae tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:07.629425 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fb52de3f-73ee-4d2c-aa48-5cd39ca5d6ae tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:07.635992 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb52de3f-73ee-4d2c-aa48-5cd39ca5d6ae tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:07.636439 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb52de3f-73ee-4d2c-aa48-5cd39ca5d6ae tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:07.637198 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb52de3f-73ee-4d2c-aa48-5cd39ca5d6ae tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:07.637628 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb52de3f-73ee-4d2c-aa48-5cd39ca5d6ae tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:07.784099 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fb52de3f-73ee-4d2c-aa48-5cd39ca5d6ae tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:07.794688 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fb52de3f-73ee-4d2c-aa48-5cd39ca5d6ae tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1756 microversion: 2.1 time: 0.169602 Jun 15 15:05:07.796118 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 580/1175] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:07 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:08.813682 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-6256faeb-72f8-4b50-9fcc-606202712598 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:08.814287 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-6256faeb-72f8-4b50-9fcc-606202712598 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:08.820734 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6256faeb-72f8-4b50-9fcc-606202712598 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:08.821177 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6256faeb-72f8-4b50-9fcc-606202712598 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:08.821926 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6256faeb-72f8-4b50-9fcc-606202712598 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:08.822360 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-6256faeb-72f8-4b50-9fcc-606202712598 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:08.966042 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-6256faeb-72f8-4b50-9fcc-606202712598 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:08.973968 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-6256faeb-72f8-4b50-9fcc-606202712598 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1756 microversion: 2.1 time: 0.164154 Jun 15 15:05:08.974565 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 596/1176] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:08 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:09.993000 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d95ebcd4-341f-41dd-a6fc-c378380237da tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:09.993611 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d95ebcd4-341f-41dd-a6fc-c378380237da tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:10.000456 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d95ebcd4-341f-41dd-a6fc-c378380237da tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:10.000905 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d95ebcd4-341f-41dd-a6fc-c378380237da tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:10.001764 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d95ebcd4-341f-41dd-a6fc-c378380237da tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:10.002199 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d95ebcd4-341f-41dd-a6fc-c378380237da tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:10.160982 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d95ebcd4-341f-41dd-a6fc-c378380237da tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:10.172681 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d95ebcd4-341f-41dd-a6fc-c378380237da tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1756 microversion: 2.1 time: 0.183083 Jun 15 15:05:10.173257 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 581/1177] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:09 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:11.189514 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a28cac7c-6621-4352-af6c-8cadc77d1151 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:11.190119 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a28cac7c-6621-4352-af6c-8cadc77d1151 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:11.197651 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a28cac7c-6621-4352-af6c-8cadc77d1151 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:11.198100 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a28cac7c-6621-4352-af6c-8cadc77d1151 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:11.198941 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a28cac7c-6621-4352-af6c-8cadc77d1151 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:11.199407 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a28cac7c-6621-4352-af6c-8cadc77d1151 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:11.343466 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-a28cac7c-6621-4352-af6c-8cadc77d1151 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:11.351972 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a28cac7c-6621-4352-af6c-8cadc77d1151 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1756 microversion: 2.1 time: 0.165600 Jun 15 15:05:11.352547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 597/1178] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:11 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:12.369618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-af6130af-1650-42f9-b102-65668b770de1 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:12.370229 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-af6130af-1650-42f9-b102-65668b770de1 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:12.377390 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af6130af-1650-42f9-b102-65668b770de1 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:12.377841 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af6130af-1650-42f9-b102-65668b770de1 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:12.378594 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af6130af-1650-42f9-b102-65668b770de1 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:12.379051 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-af6130af-1650-42f9-b102-65668b770de1 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:12.519332 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-af6130af-1650-42f9-b102-65668b770de1 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:12.527346 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-af6130af-1650-42f9-b102-65668b770de1 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1756 microversion: 2.1 time: 0.162053 Jun 15 15:05:12.527911 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 582/1179] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:12 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:13.544391 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-65cb5529-61e7-4f49-a315-1ace1c21c8fe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:13.545005 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-65cb5529-61e7-4f49-a315-1ace1c21c8fe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:13.551856 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-65cb5529-61e7-4f49-a315-1ace1c21c8fe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:13.552306 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-65cb5529-61e7-4f49-a315-1ace1c21c8fe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:13.553067 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-65cb5529-61e7-4f49-a315-1ace1c21c8fe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:13.553498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-65cb5529-61e7-4f49-a315-1ace1c21c8fe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:13.703523 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-65cb5529-61e7-4f49-a315-1ace1c21c8fe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:13.711658 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-65cb5529-61e7-4f49-a315-1ace1c21c8fe tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1756 microversion: 2.1 time: 0.171100 Jun 15 15:05:13.712219 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 598/1180] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:13 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:14.729232 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4ecce7bb-0985-457a-8406-64178857988f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:14.729818 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4ecce7bb-0985-457a-8406-64178857988f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:14.743758 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ecce7bb-0985-457a-8406-64178857988f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:14.744210 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ecce7bb-0985-457a-8406-64178857988f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:14.744973 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ecce7bb-0985-457a-8406-64178857988f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:14.745407 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4ecce7bb-0985-457a-8406-64178857988f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:14.883237 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4ecce7bb-0985-457a-8406-64178857988f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:14.891257 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4ecce7bb-0985-457a-8406-64178857988f tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1759 microversion: 2.1 time: 0.166335 Jun 15 15:05:14.891837 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 583/1181] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:14 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:18.252307 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_api:SELECT=12 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:18.253050 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG dbcounter [-] [124178] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:18.258151 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0982f0bc-1295-4b22-b3a1-a7d9ce8d9380 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1775569984"}} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:18.258678 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0982f0bc-1295-4b22-b3a1-a7d9ce8d9380 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:18.265994 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0982f0bc-1295-4b22-b3a1-a7d9ce8d9380 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:18.266441 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0982f0bc-1295-4b22-b3a1-a7d9ce8d9380 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:18.267238 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0982f0bc-1295-4b22-b3a1-a7d9ce8d9380 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:18.267674 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0982f0bc-1295-4b22-b3a1-a7d9ce8d9380 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:18.416033 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:06:18.416623 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 15:06:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:06:18.494868 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.network.security_group_api [None req-0982f0bc-1295-4b22-b3a1-a7d9ce8d9380 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Removing security group 616af9e6-89db-41b1-ace7-78fc38a4ccfc from port 9be08a1a-7a01-47e6-aa5c-f02bf206b61f Jun 15 15:06:18.840029 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0982f0bc-1295-4b22-b3a1-a7d9ce8d9380 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "POST /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/action" status: 202 len: 0 microversion: 2.1 time: 0.589459 Jun 15 15:06:18.844046 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 599/1182] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Jun 15 15:06:18 2022] POST /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:06:18.845977 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=12 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:18.846732 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=36 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:18.960542 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-76aeada2-d32c-4128-bded-913dca4d0cf0 req-9584b05a-3007-4827-b159-74307136b88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200da5f3-ea4d-4131-94c1-963bb07e5329", "tag": "9be08a1a-7a01-47e6-aa5c-f02bf206b61f"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:18.969660 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-76aeada2-d32c-4128-bded-913dca4d0cf0 req-9584b05a-3007-4827-b159-74307136b88a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:18.970105 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-76aeada2-d32c-4128-bded-913dca4d0cf0 req-9584b05a-3007-4827-b159-74307136b88a service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:18.984015 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-76aeada2-d32c-4128-bded-913dca4d0cf0 req-9584b05a-3007-4827-b159-74307136b88a service nova] Creating event network-changed:9be08a1a-7a01-47e6-aa5c-f02bf206b61f for instance 200da5f3-ea4d-4131-94c1-963bb07e5329 on hv-cinder-80382 Jun 15 15:06:18.990134 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-76aeada2-d32c-4128-bded-913dca4d0cf0 req-9584b05a-3007-4827-b159-74307136b88a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145574 Jun 15 15:06:18.991132 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 584/1183] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:19.235516 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:06:19.236071 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Wed Jun 15 15:06:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:06:19.628059 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:06:19.628721 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Wed Jun 15 15:06:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:06:20.005008 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-1e537787-8646-41c3-a4a3-152685a0c124 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:20.006765 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-1e537787-8646-41c3-a4a3-152685a0c124 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:20.012082 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e537787-8646-41c3-a4a3-152685a0c124 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:20.012547 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e537787-8646-41c3-a4a3-152685a0c124 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:20.013324 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e537787-8646-41c3-a4a3-152685a0c124 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:20.013849 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-1e537787-8646-41c3-a4a3-152685a0c124 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:20.105678 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.objects.instance [None req-1e537787-8646-41c3-a4a3-152685a0c124 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lazy-loading 'services' on Instance uuid 200da5f3-ea4d-4131-94c1-963bb07e5329 {{(pid=124178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:06:20.192409 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-1e537787-8646-41c3-a4a3-152685a0c124 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "DELETE /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments/38df820e-c956-4121-90f5-fb102bbba99c" status: 202 len: 0 microversion: 2.1 time: 0.191962 Jun 15 15:06:20.193414 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 600/1184] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 15:06:19 2022] DELETE /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments/38df820e-c956-4121-90f5-fb102bbba99c => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:06:20.205048 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c2689c5c-15af-4b4f-8045-f55ff43fdf8b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:20.206295 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c2689c5c-15af-4b4f-8045-f55ff43fdf8b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:20.213639 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2689c5c-15af-4b4f-8045-f55ff43fdf8b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:20.214958 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2689c5c-15af-4b4f-8045-f55ff43fdf8b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:20.222256 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2689c5c-15af-4b4f-8045-f55ff43fdf8b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:20.224780 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2689c5c-15af-4b4f-8045-f55ff43fdf8b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:20.260143 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c2689c5c-15af-4b4f-8045-f55ff43fdf8b tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061019 Jun 15 15:06:20.260821 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 585/1185] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 15:06:20 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:21.007176 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [req-d42c4fb0-7d38-41b7-871e-c2d992e6a1f1 req-45898911-d53f-4173-bdd8-5ec6e0bac0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200da5f3-ea4d-4131-94c1-963bb07e5329", "tag": "9be08a1a-7a01-47e6-aa5c-f02bf206b61f"}]} {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:21.016262 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-d42c4fb0-7d38-41b7-871e-c2d992e6a1f1 req-45898911-d53f-4173-bdd8-5ec6e0bac0ac service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:21.016706 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [req-d42c4fb0-7d38-41b7-871e-c2d992e6a1f1 req-45898911-d53f-4173-bdd8-5ec6e0bac0ac service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:21.029568 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.compute.server_external_events [req-d42c4fb0-7d38-41b7-871e-c2d992e6a1f1 req-45898911-d53f-4173-bdd8-5ec6e0bac0ac service nova] Creating event network-changed:9be08a1a-7a01-47e6-aa5c-f02bf206b61f for instance 200da5f3-ea4d-4131-94c1-963bb07e5329 on hv-cinder-80382 Jun 15 15:06:21.035098 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [req-d42c4fb0-7d38-41b7-871e-c2d992e6a1f1 req-45898911-d53f-4173-bdd8-5ec6e0bac0ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033051 Jun 15 15:06:21.035693 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 601/1186] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:21.274186 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e0f63e8e-24a4-4f97-a213-3fa8ec610e08 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:21.275150 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e0f63e8e-24a4-4f97-a213-3fa8ec610e08 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:21.284369 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0f63e8e-24a4-4f97-a213-3fa8ec610e08 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:21.284848 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0f63e8e-24a4-4f97-a213-3fa8ec610e08 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:21.285746 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0f63e8e-24a4-4f97-a213-3fa8ec610e08 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:21.286274 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0f63e8e-24a4-4f97-a213-3fa8ec610e08 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:21.323690 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e0f63e8e-24a4-4f97-a213-3fa8ec610e08 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054795 Jun 15 15:06:21.324451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 586/1187] 10.222.0.45 () {58 vars in 1301 bytes} [Wed Jun 15 15:06:21 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:06:21.336037 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:21.336631 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:21.342924 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:21.343408 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:21.344172 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:21.344609 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:21.420701 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] HTTP exception thrown: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 is not attached to volume 38df820e-c956-4121-90f5-fb102bbba99c Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Request method failure captured: Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: DELETE /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments/38df820e-c956-4121-90f5-fb102bbba99c HTTP/1.1 Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfSw0tng0mntGfjOd9PHvv-mj3ihoJN3NDh1PA7jDpTCgJz4Mz75ZppSHYysY4IsMeQ6Nzk_BsUUtgfjKEltG9BZlW5CR06NntlSkSngK1Uqko631JWxlS40PP8qaLtIn1Rp0dlir282oOojO5unJVjfkLlxw5qiFcy_kKzBp4bQaok Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: c54a1f9aea1a42bfb5fc36770120eb58 Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-TestMinimumBasicScenario-1436068148 Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 15:06:21.423078 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c54a1f9aea1a42bfb5fc36770120eb58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c54a1f9aea1a42bfb5fc36770120eb58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c54a1f9aea1a42bfb5fc36770120eb58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c54a1f9aea1a42bfb5fc36770120eb58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-TestMinimumBasicScenario-1436068148 Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: c54a1f9aea1a42bfb5fc36770120eb58 Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1436068148 Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-TestMinimumBasicScenario-1436068148-project Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: abf3c553d53f4118a2b4bb6ba27debe5 Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-TestMinimumBasicScenario-1436068148-project Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 15:06:21.424819 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 is not attached to volume 38df820e-c956-4121-90f5-fb102bbba99c Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'server_id': '200da5f3-ea4d-4131-94c1-963bb07e5329', 'id': '38df820e-c956-4121-90f5-fb102bbba99c'} Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 38df820e-c956-4121-90f5-fb102bbba99c. Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:06:21.429803 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 is not attached to volume 38df820e-c956-4121-90f5-fb102bbba99c Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 is not attached to volume 38df820e-c956-4121-90f5-fb102bbba99c Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:21.431488 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Returning 404 to user: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 is not attached to volume 38df820e-c956-4121-90f5-fb102bbba99c {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:06:21.432829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-0aaf7328-d00d-4b1f-856e-5c1aab4b94eb tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "DELETE /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments/38df820e-c956-4121-90f5-fb102bbba99c" status: 404 len: 154 microversion: 2.1 time: 0.092989 Jun 15 15:06:21.432829 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 602/1188] 10.222.0.45 () {58 vars in 1415 bytes} [Wed Jun 15 15:06:21 2022] DELETE /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329/os-volume_attachments/38df820e-c956-4121-90f5-fb102bbba99c => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:06:22.586451 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e98345b8-1ac2-41f4-b517-db4fb3a23df0 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:22.586981 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e98345b8-1ac2-41f4-b517-db4fb3a23df0 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:22.593618 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e98345b8-1ac2-41f4-b517-db4fb3a23df0 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:22.594073 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e98345b8-1ac2-41f4-b517-db4fb3a23df0 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:22.594979 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e98345b8-1ac2-41f4-b517-db4fb3a23df0 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:22.595442 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e98345b8-1ac2-41f4-b517-db4fb3a23df0 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:22.620969 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e98345b8-1ac2-41f4-b517-db4fb3a23df0 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:06:22.707617 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e98345b8-1ac2-41f4-b517-db4fb3a23df0 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "DELETE /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 204 len: 0 microversion: 2.1 time: 0.125113 Jun 15 15:06:22.712937 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 587/1189] 10.222.0.45 () {58 vars in 1238 bytes} [Wed Jun 15 15:06:22 2022] DELETE /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:06:22.719763 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-385053c7-3044-416f-a140-5f3760cb3175 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:22.720382 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-385053c7-3044-416f-a140-5f3760cb3175 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:22.729498 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-385053c7-3044-416f-a140-5f3760cb3175 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:22.729615 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-385053c7-3044-416f-a140-5f3760cb3175 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:22.730296 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-385053c7-3044-416f-a140-5f3760cb3175 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:22.730731 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-385053c7-3044-416f-a140-5f3760cb3175 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:22.868727 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-385053c7-3044-416f-a140-5f3760cb3175 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:22.878203 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-385053c7-3044-416f-a140-5f3760cb3175 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1554 microversion: 2.1 time: 0.163788 Jun 15 15:06:22.878760 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 603/1190] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:22 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:23.897938 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9e0bc70d-ec1c-4113-8ca0-906def52e711 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:23.898634 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9e0bc70d-ec1c-4113-8ca0-906def52e711 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:23.905139 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e0bc70d-ec1c-4113-8ca0-906def52e711 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:23.905587 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e0bc70d-ec1c-4113-8ca0-906def52e711 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:23.906349 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e0bc70d-ec1c-4113-8ca0-906def52e711 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:23.906782 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e0bc70d-ec1c-4113-8ca0-906def52e711 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:24.041487 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9e0bc70d-ec1c-4113-8ca0-906def52e711 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:24.049110 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9e0bc70d-ec1c-4113-8ca0-906def52e711 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1554 microversion: 2.1 time: 0.156057 Jun 15 15:06:24.049681 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 588/1191] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:23 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:25.066325 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-70b870ad-64b7-486b-8bb4-e5389d2b4235 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:25.066962 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-70b870ad-64b7-486b-8bb4-e5389d2b4235 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:25.074084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70b870ad-64b7-486b-8bb4-e5389d2b4235 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:25.074655 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70b870ad-64b7-486b-8bb4-e5389d2b4235 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:25.075447 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70b870ad-64b7-486b-8bb4-e5389d2b4235 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:25.075881 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-70b870ad-64b7-486b-8bb4-e5389d2b4235 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:25.215717 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.policy [None req-70b870ad-64b7-486b-8bb4-e5389d2b4235 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf3c553d53f4118a2b4bb6ba27debe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a1f9aea1a42bfb5fc36770120eb58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124178) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:25.224019 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-70b870ad-64b7-486b-8bb4-e5389d2b4235 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 200 len: 1554 microversion: 2.1 time: 0.161506 Jun 15 15:06:25.232353 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 604/1192] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:25 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:25.329514 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-6c573f85-ef6e-45b3-ba08-1448dc5194dc req-49358a4b-ae7e-4612-8f8b-3338ce8df4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200da5f3-ea4d-4131-94c1-963bb07e5329", "name": "network-vif-deleted", "tag": "9be08a1a-7a01-47e6-aa5c-f02bf206b61f"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:25.338824 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-6c573f85-ef6e-45b3-ba08-1448dc5194dc req-49358a4b-ae7e-4612-8f8b-3338ce8df4d0 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:25.339330 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-6c573f85-ef6e-45b3-ba08-1448dc5194dc req-49358a4b-ae7e-4612-8f8b-3338ce8df4d0 service nova] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:25.352591 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-6c573f85-ef6e-45b3-ba08-1448dc5194dc req-49358a4b-ae7e-4612-8f8b-3338ce8df4d0 service nova] Creating event network-vif-deleted:9be08a1a-7a01-47e6-aa5c-f02bf206b61f for instance 200da5f3-ea4d-4131-94c1-963bb07e5329 on hv-cinder-80382 Jun 15 15:06:25.358700 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-6c573f85-ef6e-45b3-ba08-1448dc5194dc req-49358a4b-ae7e-4612-8f8b-3338ce8df4d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096802 Jun 15 15:06:25.359361 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 589/1193] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:26.240419 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '>' {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:26.241027 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.compute.api [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] [instance: 200da5f3-ea4d-4131-94c1-963bb07e5329] Fetching instance by UUID {{(pid=124178) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:26.248250 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:26.248703 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:26.249553 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:26.250082 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG oslo_concurrency.lockutils [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Lock "095ba511-08d8-4454-8c74-3289cb8a8527" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:26.264555 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.wsgi [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] HTTP exception thrown: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 could not be found. Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Request method failure captured: Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: request: GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 HTTP/1.1 Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept: application/json Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Accept-Encoding: identity Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Connection: close Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Length: 0 Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Content-Type: application/json Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Host: 10.222.0.45 Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Openstack-System-Scope: None Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: User-Agent: python-urllib3/1.26.9 Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Auth-Token: gAAAAABiqfSw0tng0mntGfjOd9PHvv-mj3ihoJN3NDh1PA7jDpTCgJz4Mz75ZppSHYysY4IsMeQ6Nzk_BsUUtgfjKEltG9BZlW5CR06NntlSkSngK1Uqko631JWxlS40PP8qaLtIn1Rp0dlir282oOojO5unJVjfkLlxw5qiFcy_kKzBp4bQaok Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Id: None Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Domain-Name: None Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Identity-Status: Confirmed Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Is-Admin-Project: True Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Id: default Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Domain-Name: Default Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Id: c54a1f9aea1a42bfb5fc36770120eb58 Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Project-Name: tempest-TestMinimumBasicScenario-1436068148 Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Role: reader,member Jun 15 15:06:26.266084 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Roles: reader,member Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c54a1f9aea1a42bfb5fc36770120eb58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c54a1f9aea1a42bfb5fc36770120eb58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c54a1f9aea1a42bfb5fc36770120eb58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c54a1f9aea1a42bfb5fc36770120eb58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant: tempest-TestMinimumBasicScenario-1436068148 Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Id: c54a1f9aea1a42bfb5fc36770120eb58 Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1436068148 Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User: tempest-TestMinimumBasicScenario-1436068148-project Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Id: default Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Domain-Name: Default Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Id: abf3c553d53f4118a2b4bb6ba27debe5 Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: X-User-Name: tempest-TestMinimumBasicScenario-1436068148-project Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: method: > Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: exception: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 could not be found. Jun 15 15:06:26.267762 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: action_args: {'id': '200da5f3-ea4d-4131-94c1-963bb07e5329'} Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: {{(pid=124178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 could not be found. Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:06:26.268656 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 could not be found. Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 could not be found. Jun 15 15:06:26.270158 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.272169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: DEBUG nova.api.openstack.wsgi [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Returning 404 to user: Instance 200da5f3-ea4d-4131-94c1-963bb07e5329 could not be found. {{(pid=124178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:06:26.272169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO nova.api.openstack.requestlog [None req-a4ff202c-9277-4b08-b4ef-97f73b38209d tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329" status: 404 len: 111 microversion: 2.1 time: 0.030983 Jun 15 15:06:26.272169 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: [pid: 124178|app: 0|req: 605/1194] 10.222.0.45 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:26 2022] GET /compute/v2.1/servers/200da5f3-ea4d-4131-94c1-963bb07e5329 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:06:26.277840 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3001394c-7ae1-4e69-914e-de535e73df51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] Calling method '.version_select at 0x7f05bc102b80>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:26.299791 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3001394c-7ae1-4e69-914e-de535e73df51 tempest-TestMinimumBasicScenario-1436068148 tempest-TestMinimumBasicScenario-1436068148-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1757897064" status: 202 len: 0 microversion: 2.1 time: 0.026517 Jun 15 15:06:26.300368 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 590/1195] 10.222.0.45 () {58 vars in 1271 bytes} [Wed Jun 15 15:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1757897064 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:07:50.369670 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:07:50.370400 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 15:07:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:09:38.424449 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:09:38.425176 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 15:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:09:39.245249 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:09:39.245838 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Wed Jun 15 15:09:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:09:39.636798 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:09:39.637039 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Wed Jun 15 15:09:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:11:10.378272 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:11:10.378901 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 15:11:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:11:38.742591 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:11:38.743141 dv-cinder-803823-10-iscsi devstack@n-api.service[124178]: Wed Jun 15 15:11:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:11:40.178161 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:11:40.178803 dv-cinder-803823-10-iscsi devstack@n-api.service[124179]: Wed Jun 15 15:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!